-- Logs begin at Mon 2022-08-29 19:43:51 UTC, end at Mon 2022-08-29 20:53:59 UTC. -- Aug 29 20:24:12.864396 dv-cinder-854263-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 20:24:12.874015 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 20:24:12.875539 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 20:24:12 2022] *** Aug 29 20:24:12.875539 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 20:24:12.875539 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 20:24:12.875539 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: nodename: dv-cinder-854263-2-iscsi Aug 29 20:24:12.875539 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: machine: x86_64 Aug 29 20:24:12.875539 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: clock source: unix Aug 29 20:24:12.875539 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: pcre jit disabled Aug 29 20:24:12.875539 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: detected number of CPU cores: 4 Aug 29 20:24:12.875539 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: current working directory: / Aug 29 20:24:12.875539 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: detected binary path: /usr/bin/uwsgi-core Aug 29 20:24:12.876285 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: your processes number limit is 47680 Aug 29 20:24:12.876285 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: your memory page size is 4096 bytes Aug 29 20:24:12.876285 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: detected max file descriptor number: 2048 Aug 29 20:24:12.876285 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: lock engine: pthread robust mutexes Aug 29 20:24:12.876285 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: thunder lock: enabled Aug 29 20:24:12.876285 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 20:24:12.876285 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 20:24:12.915222 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: Python main interpreter initialized at 0x55bd869cb9c0 Aug 29 20:24:12.915222 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: python threads support enabled Aug 29 20:24:12.915222 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: your server socket listen backlog is limited to 100 connections Aug 29 20:24:12.915222 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: your mercy for graceful operations on workers is 90 seconds Aug 29 20:24:12.915622 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 20:24:12.915622 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: *** Operational MODE: preforking *** Aug 29 20:24:12.915881 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: *** uWSGI is running in multiple interpreter mode *** Aug 29 20:24:12.915881 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: spawned uWSGI master process (pid: 105381) Aug 29 20:24:12.916150 dv-cinder-854263-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 20:24:12.916644 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: spawned uWSGI worker 1 (pid: 105382, cores: 1) Aug 29 20:24:12.918121 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: spawned uWSGI worker 2 (pid: 105383, cores: 1) Aug 29 20:24:12.918121 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 20:24:13.571222 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:24:13.587403 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:24:14.652327 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:24:14.652327 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: from cryptography.utils import int_from_bytes Aug 29 20:24:14.652918 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:24:14.652918 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: from cryptography.utils import int_from_bytes Aug 29 20:24:14.667151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:24:14.667151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: from cryptography.utils import int_from_bytes Aug 29 20:24:14.667632 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:24:14.667632 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: from cryptography.utils import int_from_bytes Aug 29 20:24:17.113321 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:24:17.113880 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:24:17.114079 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:24:17.114441 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:24:17.114695 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:24:17.115084 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.115408 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.115729 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.116074 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.116406 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.116714 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.117035 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.117352 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.117677 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.117934 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.118249 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.118571 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854263-2-iscsi {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.118828 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:24:17.119212 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.119300 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:24:17.119378 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.119469 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.119597 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:24:17.119776 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.119983 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:24:17.120106 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.120244 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:24:17.120425 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.120627 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.120725 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.120951 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.121220 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.121325 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.121578 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.121709 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.121908 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.122030 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.122220 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.122335 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.122541 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.122664 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.122865 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.123001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.123169 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.123299 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.123420 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.123544 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.123736 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.123866 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.124081 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854263-2-iscsi {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.124210 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.124405 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.124534 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.124711 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.124839 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854263-2-iscsi {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.125042 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.125179 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.125303 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.125425 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.125608 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.125748 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.125927 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.126098 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.126227 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.126407 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.127390 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.127530 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.127692 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.127847 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.128005 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.128145 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.128319 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.128449 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.128646 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.128774 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.128969 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.129112 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.129279 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.129408 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.129598 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.129726 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.129901 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.130031 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.130279 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.130416 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.130540 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.130673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.130820 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.130947 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854263-2-iscsi {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.131125 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.131255 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.131428 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.131565 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.131698 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.131834 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.131994 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.132196 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.132327 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.132510 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.132639 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.132820 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.132948 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.133147 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.133297 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.133424 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.133556 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.133681 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.133814 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.133998 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.134122 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.134323 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.134418 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.134613 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.134710 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.134919 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.135005 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.135230 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.135323 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.135535 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.135629 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.135838 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.135924 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.136171 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.136258 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.136478 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.136572 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.136779 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.136863 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.137032 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.137124 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.137340 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.137433 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.137660 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.137761 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.137980 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.138076 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.138296 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.138386 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.138547 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.138633 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.138796 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.138912 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.139114 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.139255 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.139434 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.139567 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.139742 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.139881 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.140074 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.140195 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.140381 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.140519 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.140688 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.140826 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.140993 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.141135 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.141298 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.141426 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.141604 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.141743 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.141908 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.142038 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.142309 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.142445 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.142565 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.142673 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.142845 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.142975 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.143149 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.143278 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.143467 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.143596 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.143773 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.144014 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.144158 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.144284 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.144416 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.144577 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.144713 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.144918 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.145046 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.145238 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.145388 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.145547 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.145684 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.145855 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.145991 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.146159 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.146301 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.146461 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.146590 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.146763 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.146898 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.147068 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.147195 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.147367 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.147514 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.147684 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.147813 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.148010 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.148152 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.148277 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.148411 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.148536 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.148659 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.148842 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.148980 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.149162 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.149303 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.149470 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.149606 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.149776 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.149920 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.150078 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.150204 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.150375 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.150501 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.150705 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.150831 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.150977 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.151113 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.151281 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.151408 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.151586 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.151716 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.151889 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.152038 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.152215 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.152357 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.152527 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.152654 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.152830 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.152964 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.153134 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.153273 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.153438 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.153565 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.153743 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.153871 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.154045 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.154251 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.154394 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.154518 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.154641 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.154764 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.154909 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.155044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.155214 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.155344 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.155513 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.155649 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.155811 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.155979 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.156151 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.156294 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.156457 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.156592 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.156766 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.156903 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.157068 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.157196 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.157372 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.157510 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.157680 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.157808 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.158092 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.158218 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.158428 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.158566 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.158734 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.158862 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.159052 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.159204 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.159362 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.159498 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.159672 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.159810 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.159995 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.160161 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.160288 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.160424 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.160596 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.160726 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.160903 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.161031 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.161470 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.161609 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.161776 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.161905 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.162076 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.162204 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.162390 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.162531 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.162707 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.162848 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.163015 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.163141 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.163323 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.163463 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.163632 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.163761 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.163957 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.164087 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:24:17.164275 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.164412 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.164590 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.164719 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.164917 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.165047 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.165240 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.165369 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.165549 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.165677 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.165886 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.166026 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.166210 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.166330 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.166524 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.166624 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.166840 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.166942 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.167156 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.167241 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.167464 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.167572 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.167775 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.167874 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.168110 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.168214 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.168433 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.168574 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.168750 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.168885 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.169065 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.169241 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.169371 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.169498 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.169674 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.169811 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.169994 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.170122 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.170301 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.170421 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.170609 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.170751 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.170916 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.171046 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.171228 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.171358 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.171536 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.171677 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.171870 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.172029 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.172215 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.172354 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.172535 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.172737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.172863 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.172985 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.173145 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.173271 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.173977 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.174162 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.174362 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.174538 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.174744 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.174943 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.175111 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.175294 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.175469 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.175594 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.175734 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.175857 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.176077 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.176205 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.176330 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.176452 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.176581 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.176703 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.176835 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.176958 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.177080 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.177262 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.177398 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.177575 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.177712 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.177890 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.178017 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.178197 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.178364 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.178502 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.178629 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.178801 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.178923 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.179105 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.179243 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.179418 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.179548 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.179728 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.179857 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.180057 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.180200 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.180377 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.180499 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.180688 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.180818 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.180995 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.181123 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.181297 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.181432 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.181603 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.181733 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.181904 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.182042 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.182213 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.182342 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.182522 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.182651 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.182833 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.182976 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.183143 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.183279 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.183453 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.183581 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.183772 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.183909 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.184104 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.184232 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.184414 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.184542 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.184725 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.184862 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.185035 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.185171 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.185341 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.185470 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.185657 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.185787 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.185972 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.186100 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.186279 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.186416 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.186579 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.186708 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.186888 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.187016 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.187191 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.187320 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.187494 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.187624 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.187797 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.187983 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.188122 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.188247 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.188419 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.188554 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.188722 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.188853 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.189025 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.189197 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.189900 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.190015 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.190207 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.190336 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.190529 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.190666 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.190837 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.190968 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.191138 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.191267 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.191440 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.191578 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.191741 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.191870 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.192108 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.192247 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.192415 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.192554 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.192756 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.192891 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.193091 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.193220 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.193408 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.193546 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.193730 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.193856 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.194037 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.194174 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.194343 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.194472 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.194648 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.194784 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.194957 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.195091 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.195257 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.195386 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.195561 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.195689 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.195866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.196012 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.196199 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.196328 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.196502 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.196637 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.196812 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.196940 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.197123 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.197253 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.197427 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.197555 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.197732 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.197880 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.198033 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.198152 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.198347 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.198476 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.198665 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.198797 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.199004 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.199130 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.199319 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.199448 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.199640 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.199779 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.199969 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.200101 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.200285 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.200425 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.200591 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.200732 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.200901 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.201032 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.201211 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.201337 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.201517 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.201652 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.201825 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.201952 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.202130 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.202265 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.202480 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.202609 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.202733 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.202856 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.203045 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.203173 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.203354 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.203484 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.203663 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.203790 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.203981 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.204111 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.204299 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.204428 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.204615 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.204765 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.204975 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.205111 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.205284 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.205422 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.205595 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.205723 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.205914 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.206053 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.206221 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.206359 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.206529 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.206837 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.206983 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.207141 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.207270 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.207443 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.207578 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.207750 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.207889 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.208070 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.208208 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.208380 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.208502 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.208686 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.208826 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.208989 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.209117 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.209298 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.209428 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.209605 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.209735 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.209906 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.210035 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.210209 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.210330 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.210519 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.210649 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.210842 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.210971 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.211151 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.211279 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.211471 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.211601 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.211781 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.211908 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.212109 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.212238 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.212413 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.212543 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.212730 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.212869 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.213035 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.213173 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.213337 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.213465 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.213637 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.213774 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.213938 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.214077 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.214269 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.214396 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.214552 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.214681 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.214862 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.215003 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.215166 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.215293 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.215483 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.215612 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.215788 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.215925 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.216115 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.216251 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.216408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.216544 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.216712 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.216848 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.217030 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.217167 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.217339 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.217466 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.217643 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.217771 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.217949 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.218078 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.218258 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.218384 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.218564 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.218700 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.218869 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.218988 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.219185 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.219314 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.219489 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.219617 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.219790 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.219918 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.220119 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.220258 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.220444 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.220616 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.220745 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.220934 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.221062 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.221241 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.221558 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.221692 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.221881 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.222009 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.222199 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.222345 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.222516 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.222643 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.222825 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.222953 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.223136 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.223274 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.223461 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.223600 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.223776 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.223906 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.224110 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.224239 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.224416 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.224547 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.224723 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.224851 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.225036 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.225157 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.225355 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.225475 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.225620 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.225761 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.225921 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.226060 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.226223 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.226353 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.226523 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.226653 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.226825 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.226962 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.227121 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.227248 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.227419 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.227548 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.227718 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.228014 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.228147 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.228341 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.228472 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.228641 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.228771 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.228968 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.229085 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.229234 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.229370 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.229553 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.229690 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.229858 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.230005 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.230157 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.230286 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.230454 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.230583 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.230754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.230876 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.231092 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.231222 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.231394 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.231523 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.231704 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.231834 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.232046 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.232191 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.232356 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.232485 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.232663 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.232793 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.232965 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.233100 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.233274 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.233401 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.233574 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.233703 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.233873 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.233996 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.234173 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.234303 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.234478 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.234571 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.234779 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.234865 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.235082 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.235176 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.235387 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.235471 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.235689 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.235772 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.236553 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.236661 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.236868 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.237014 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.237152 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.237287 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.237457 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.237557 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.237759 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.237852 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.238067 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.238195 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.238370 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.238510 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.238738 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.238955 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.239192 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.239431 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.239675 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.239906 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.240129 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.240285 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.240425 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.240565 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.240716 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.240716 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.240991 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.240991 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.241252 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.241390 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.241537 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.241537 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.241800 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.241957 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.242096 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.242243 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.242383 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.242534 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.242683 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.242822 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.242959 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.243105 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.243244 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.243382 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.243519 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.243675 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.243813 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.243984 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.244131 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.244270 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.244407 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.244557 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.244696 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.244844 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.244984 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.245121 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.245266 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.245405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.245564 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.245704 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.245841 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.245978 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.246116 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.246253 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.246419 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.246561 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.246705 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.246844 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.246981 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.247118 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.247264 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.247412 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.247549 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.247695 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.247833 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.247990 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.248147 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.248295 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.248435 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.248572 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.248710 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.248856 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.248995 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.249132 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.249285 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.249430 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.249579 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.249728 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.249867 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.250011 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.250158 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.250296 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.250434 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.250581 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.250721 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.250858 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.250995 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.251149 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.251294 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.251446 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.251628 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.252318 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.252417 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.252498 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.252655 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.252754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.252962 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.253060 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.253281 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.253369 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.253580 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.253668 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.253885 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.253971 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.254189 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.254283 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.254499 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.254586 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.254799 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.254891 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.255102 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.255195 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.255406 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.255502 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.255710 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.255796 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.256042 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.256149 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.256361 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.256446 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.256673 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.256757 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.256979 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.257075 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.257280 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.257366 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.257581 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.257665 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.257887 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.257987 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.258194 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.258280 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.258501 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.258594 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.258810 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.258939 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.259154 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.259267 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.259425 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.259528 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.259734 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.259822 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.260067 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.260158 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.260378 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.260464 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.260681 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.260782 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.260990 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.261129 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.261297 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.261390 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.261598 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.261692 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.261899 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.261984 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.262204 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.262289 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.262503 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.262589 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.262808 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.262894 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.263111 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.263249 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.263419 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.263505 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.263721 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.263808 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.264093 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.264196 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.264402 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.264489 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.264713 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.264799 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.265025 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.265123 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.265336 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.265422 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.265646 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.265731 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.265957 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.266052 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.266268 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.266358 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.266575 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.266661 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.266884 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.266977 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.267303 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.267397 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.267631 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.267716 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.267963 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.268066 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.268264 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.268350 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.268570 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.268655 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.268880 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.269069 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.269228 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.269379 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.269552 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.269695 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.269843 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.269982 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.270128 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.270267 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.270405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.270543 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.270697 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.270849 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.270989 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.271126 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.271362 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.271519 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.271667 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.271807 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.271976 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.272122 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.272371 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.272531 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.272672 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.272809 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.272972 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.273125 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.273292 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.273457 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.273604 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.273741 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.273879 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.274017 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.274211 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.274369 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.274509 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.274647 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.274821 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.274968 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.275144 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.275298 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.275474 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.275620 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.275766 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.275906 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.276088 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.276230 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.276402 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.276548 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.276708 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.276852 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.277091 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.277243 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.277404 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.277544 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.277690 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.277838 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.277979 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.278117 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.278265 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.278406 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.278616 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.278764 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.278935 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.279092 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.279243 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.279393 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.279532 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.279669 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.279830 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.280010 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.280166 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.280314 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.280454 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.280593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.280738 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.280885 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.281040 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.281185 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.281338 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.281484 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.281624 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.281798 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.281953 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.282092 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.282231 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.282418 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.282573 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.282726 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.282893 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.283120 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.283274 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.283431 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.283587 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.283727 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.283865 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.284054 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.284212 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.284378 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.284537 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.284700 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.284847 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.285007 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.285155 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.285312 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.285461 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.285635 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.285791 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.285931 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.286328 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.286473 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.286651 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.286799 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.286978 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.287132 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.287273 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.287426 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.287576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.287715 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.287852 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.288037 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.288184 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.288332 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.288482 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.288629 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.288797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.288958 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.289107 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.289260 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.289407 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.289570 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.289716 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.289860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.290013 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.290166 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.290311 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.290456 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.290608 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.290755 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.290909 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.291056 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.291200 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.291372 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.291519 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.291664 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.291817 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.291985 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.292139 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.292285 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.292429 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.292583 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.292740 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.292887 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.293032 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.293176 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.293330 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.293484 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.293631 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.293776 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.293928 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.294074 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.294219 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.294440 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.294588 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.294733 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.294879 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.295023 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.295167 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.295331 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.295477 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.295623 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.295768 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.295913 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.296116 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.296275 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.296430 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.296578 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.296731 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.296878 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.297037 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.297200 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.297346 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.297490 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.297636 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.297780 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.297936 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.298090 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.298236 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.298381 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.299102 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.299251 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.299406 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.299554 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.299710 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.299856 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.300025 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.300174 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.300332 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.300479 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.300633 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.300788 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.300934 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.301097 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.301245 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.301390 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.301534 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.301690 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.301845 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.302001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.302148 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.302294 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.302439 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.302591 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.302737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.302892 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.303055 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.303202 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.303354 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.303500 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.303683 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.303855 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.304109 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.304260 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.304407 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.304552 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.305274 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.305434 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.305584 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.305737 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.305883 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.306049 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.306197 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.306342 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.306488 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.306642 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.306789 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.306950 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.307105 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.307251 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.307397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.307549 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.307708 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.307877 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.308046 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.308145 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.308230 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.308310 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.308407 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.308499 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.308580 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.308659 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.308659 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.308802 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.308940 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.309162 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.309322 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.309482 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.309639 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.309815 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.309965 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.310150 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.310304 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.310525 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.310680 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.310835 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.310988 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.311142 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.311300 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.311452 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.311600 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.311754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.311900 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.312086 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.312281 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.312436 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.312667 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.312834 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.312981 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.313182 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.313335 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.313647 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.313822 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.313975 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.314202 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.314880 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.315036 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.315194 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.315342 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.315540 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.315701 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.315904 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.316118 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.316267 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.316411 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.316557 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.316702 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.316855 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.317011 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.317157 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.317308 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.317454 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.317599 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.317743 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.317912 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.318059 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.318204 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.318356 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.318503 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.318664 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.318818 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.318965 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.319111 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.319255 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.319466 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.319654 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.319817 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.319987 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.320140 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.320286 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.320464 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.320631 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.320786 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.320931 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.321077 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.321220 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.321372 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.321533 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.321680 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.321843 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.321990 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.322200 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.322363 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.322511 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.322655 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.322835 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.322994 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.323145 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.323298 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.323445 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.323598 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.323744 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.323900 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.324096 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.324322 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.324471 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.324623 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.324769 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.324914 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.325068 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.325216 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.325368 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.325514 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.325672 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.325829 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.326006 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.326158 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.326311 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.326457 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.326609 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.326761 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.326914 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.327061 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.327206 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.327351 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.327496 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.327657 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.327822 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.327822 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.328124 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.328282 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.328428 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.328582 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.328728 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.328873 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.329018 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.329163 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.329307 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.329461 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.329614 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.329859 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.330010 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.330184 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.330371 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.330532 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.330678 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.330823 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.330998 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.331151 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.331305 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.331463 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.331609 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.331767 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.331927 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.332171 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.332399 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.332617 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.332820 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.333036 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.333250 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.333250 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.333655 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.333858 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.334059 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.334258 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.334459 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.334676 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.334890 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.335093 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.335294 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.335496 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.335706 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.335924 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.335924 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.336544 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.336786 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.337024 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.337265 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.337547 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.337775 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.337932 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.338078 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.338223 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.338370 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.338525 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.338673 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.338818 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.338981 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.339218 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.339460 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.339705 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.340010 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.340206 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.340206 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.340206 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.340206 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.340206 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.340206 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.341039 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.341185 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.341330 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.341485 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.341631 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.341791 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.341939 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.342085 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.342230 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.342384 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.342533 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.342687 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.342833 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.342978 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.343135 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.343290 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.343446 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.343593 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.343749 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.343895 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.344096 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.344256 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.344402 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.344555 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.344700 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.344845 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.344845 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.345133 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.345287 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.345966 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.346112 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.346272 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.346428 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.346583 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.346729 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.346882 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.347028 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.347174 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.347333 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.347480 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.347625 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.347770 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.347915 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.348118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.348268 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.348413 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.348558 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.348703 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.348848 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.349002 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.349148 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.349295 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.349439 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.349591 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.349745 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.349913 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.350061 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.350206 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.350351 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.350495 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.350656 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.350803 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.350947 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.351093 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.351238 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.351383 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.351537 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.351682 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.351837 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.352004 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.352157 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.352302 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.352460 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.352607 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.352752 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.352897 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.353050 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.353206 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.353353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.353504 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.353665 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.353818 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.353972 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.354128 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.354275 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.354275 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.354552 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.354704 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.354850 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.355069 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.355224 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.355378 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.355524 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.355681 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.355826 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.356045 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.356045 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.356331 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.356478 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.356623 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.356777 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.356923 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.357067 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.357211 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.357357 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.357357 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.357655 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.357811 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.357965 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.358111 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.358256 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.358400 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.358555 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.358701 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.358846 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.358990 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.359135 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.359354 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.359527 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.359675 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.359828 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.359997 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.360150 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.360348 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.360501 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.360654 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.360800 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.361007 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.361662 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.361822 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.361970 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.362126 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.362271 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.362417 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.362562 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.362716 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.362862 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.363008 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.363153 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.363297 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.363498 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.363663 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.363810 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.364021 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.364175 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.364331 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.364487 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.364634 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.364788 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.364934 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.365080 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.365226 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.365385 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.365531 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.365684 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.365837 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.365995 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.366150 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.366359 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.366508 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.366661 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.366818 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.366972 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.367128 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.367275 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.367419 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.367564 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.367709 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.367876 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.368128 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.368128 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.368409 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.368563 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.368707 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.368851 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.369016 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.369170 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.369324 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.369324 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.369601 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.369601 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.369906 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.370053 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.370204 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.370351 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.370502 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.370661 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.370807 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.370952 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.371096 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.371241 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.371387 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.371541 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.371694 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.371851 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.372040 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.372189 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.372347 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.372495 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.372639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.372784 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.372930 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.373081 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.373237 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.373384 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.373537 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.373697 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.373842 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.373986 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.374140 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.374286 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:24:17.374438 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.374438 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.374438 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.374438 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.374438 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.374438 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.375251 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.375251 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.375537 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.375689 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.375973 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.376296 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.376637 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.376972 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.377288 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.377603 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.377917 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.378231 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.378543 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.378862 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.379178 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.379492 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.379812 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.380162 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.380497 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.380827 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.381141 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.381471 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.381801 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.382149 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.382464 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.382810 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.383142 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.383458 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.383773 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.384108 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:24:17.384354 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:24:17.525219 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO dbcounter [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] Registered counter for database nova_api Aug 29 20:24:17.539317 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO dbcounter [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Registered counter for database nova_api Aug 29 20:24:17.547304 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG oslo_db.sqlalchemy.engines [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:24:17.554020 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG dbcounter [-] [105383] Writer thread running {{(pid=105383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:24:17.560020 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_db.sqlalchemy.engines [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:24:17.567351 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG dbcounter [-] [105382] Writer thread running {{(pid=105382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:24:17.611151 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.context [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26164e1e-1563-420b-9abf-15fd66346c73(cell1) {{(pid=105383) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:24:17.615061 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG oslo_concurrency.lockutils [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:17.615486 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG oslo_concurrency.lockutils [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:17.617087 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG oslo_concurrency.lockutils [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:17.617809 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG oslo_concurrency.lockutils [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:17.618251 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG oslo_concurrency.lockutils [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:17.620250 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG oslo_concurrency.lockutils [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:17.622188 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO dbcounter [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] Registered counter for database nova_cell0 Aug 29 20:24:17.623327 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.context [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26164e1e-1563-420b-9abf-15fd66346c73(cell1) {{(pid=105382) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:24:17.626215 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO dbcounter [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] Registered counter for database nova_cell1 Aug 29 20:24:17.628213 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:17.628690 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:17.630262 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:17.631126 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:24:17.631422 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:24:17.633498 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:24:17.634652 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG oslo_db.sqlalchemy.engines [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:24:17.635557 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO dbcounter [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Registered counter for database nova_cell0 Aug 29 20:24:17.636369 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG oslo_db.sqlalchemy.engines [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:24:17.641481 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO dbcounter [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Registered counter for database nova_cell1 Aug 29 20:24:17.641865 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG dbcounter [-] [105383] Writer thread running {{(pid=105383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:24:17.647700 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG dbcounter [-] [105383] Writer thread running {{(pid=105383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:24:17.649346 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_db.sqlalchemy.engines [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:24:17.652805 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_db.sqlalchemy.engines [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:24:17.655257 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG dbcounter [-] [105382] Writer thread running {{(pid=105382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:24:17.790293 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO dbcounter [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] Registered counter for database nova_cell0 Aug 29 20:24:17.799328 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG oslo_db.sqlalchemy.engines [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:24:17.800084 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG dbcounter [-] [105382] Writer thread running {{(pid=105382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:24:17.803679 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG dbcounter [-] [105383] Writer thread running {{(pid=105383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:24:17.809061 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO dbcounter [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Registered counter for database nova_cell0 Aug 29 20:24:17.816549 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_db.sqlalchemy.engines [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:24:17.820999 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG dbcounter [-] [105382] Writer thread running {{(pid=105382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:24:18.139839 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: WARNING keystonemiddleware.auth_token [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:24:18.141387 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: WARNING keystonemiddleware.auth_token [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:24:18.147717 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: WARNING keystonemiddleware.auth_token [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:24:18.149156 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: WARNING keystonemiddleware.auth_token [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:24:18.490262 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: WARNING keystonemiddleware.auth_token [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:24:18.493727 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: WARNING keystonemiddleware.auth_token [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:24:18.496155 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: WARNING keystonemiddleware.auth_token [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:24:18.499571 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: WARNING keystonemiddleware.auth_token [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:24:18.501378 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd869cb9c0 pid: 105383 (default app) Aug 29 20:24:18.504054 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:24:18.505267 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-7400e7e9-bd24-4fa2-bb3d-3720c59bac58 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001764 Aug 29 20:24:18.505461 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd869cb9c0 pid: 105382 (default app) Aug 29 20:24:18.505681 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Mon Aug 29 20:24:18 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:38.255571 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:38.256847 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 Aug 29 20:25:38.257259 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 29 20:25:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:38.273236 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG dbcounter [-] [105383] Writing DB stats nova_api:SELECT=3 {{(pid=105383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:38.274181 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG dbcounter [-] [105383] Writing DB stats nova_cell0:SELECT=3 {{(pid=105383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:38.274948 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG dbcounter [-] [105383] Writing DB stats nova_cell1:SELECT=3 {{(pid=105383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:38.276024 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG dbcounter [-] [105383] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:39.162284 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-94ef38a6-1420-4a53-a089-e6b7873bfc40 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:39.201266 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-94ef38a6-1420-4a53-a089-e6b7873bfc40 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.937636 Aug 29 20:25:39.202256 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1292 bytes} [Mon Aug 29 20:25:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:41.582075 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:41.583089 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-a64aab71-f055-48bb-9267-2e937bd80a5f None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 29 20:25:41.583769 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 2/4] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 29 20:25:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:42.054717 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-b4a6043a-d075-41b2-9b64-5133d1c3d97f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "id": "c1", "ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:42.102124 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-b4a6043a-d075-41b2-9b64-5133d1c3d97f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.511562 Aug 29 20:25:42.103976 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 3/5] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 29 20:25:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:25:42.323340 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-b2b4e6ff-ea24-4634-99bd-3820bf1df2a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:42.342639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG dbcounter [-] [105382] Writing DB stats nova_api:SELECT=3 {{(pid=105382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:42.344086 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG dbcounter [-] [105382] Writing DB stats nova_cell0:SELECT=3 {{(pid=105382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:42.345712 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG dbcounter [-] [105382] Writing DB stats nova_cell1:SELECT=3 {{(pid=105382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:42.346546 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG dbcounter [-] [105382] Writing DB stats nova_cell0:SELECT=3 {{(pid=105382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:42.400455 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-b2b4e6ff-ea24-4634-99bd-3820bf1df2a5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287563 Aug 29 20:25:42.400455 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 3/6] 10.222.0.18 () {64 vars in 1336 bytes} [Mon Aug 29 20:25:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:44.800283 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-b4a6043a-d075-41b2-9b64-5133d1c3d97f admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:44.801313 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-b4a6043a-d075-41b2-9b64-5133d1c3d97f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 29 20:25:44.801714 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 4/7] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 29 20:25:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:45.471188 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-c9c9fe26-93b1-4544-9ac2-c32b748f0206 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "disk": 5, "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:45.511842 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-c9c9fe26-93b1-4544-9ac2-c32b748f0206 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.703947 Aug 29 20:25:45.512801 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 4/8] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 29 20:25:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:25:45.525146 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-930b38dc-5cef-4892-abd4-741303739fed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:45.571710 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-930b38dc-5cef-4892-abd4-741303739fed admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050115 Aug 29 20:25:45.572266 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 5/9] 10.222.0.18 () {64 vars in 1336 bytes} [Mon Aug 29 20:25:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:48.064623 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-c9c9fe26-93b1-4544-9ac2-c32b748f0206 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:48.065855 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-c9c9fe26-93b1-4544-9ac2-c32b748f0206 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001661 Aug 29 20:25:48.066441 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 29 20:25:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:48.440348 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-988f8149-ebfb-4f1a-b927-945b4a5427bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "name": "ds1G", "id": "d2"}} {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:48.459716 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-988f8149-ebfb-4f1a-b927-945b4a5427bf admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.386810 Aug 29 20:25:48.460313 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 6/11] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 29 20:25:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:25:48.472651 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-e8420b39-bec3-4647-a4da-60c7438ec174 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:48.496948 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-e8420b39-bec3-4647-a4da-60c7438ec174 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027988 Aug 29 20:25:48.497521 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 6/12] 10.222.0.18 () {64 vars in 1336 bytes} [Mon Aug 29 20:25:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:25:50.869405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-988f8149-ebfb-4f1a-b927-945b4a5427bf admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:50.870335 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-988f8149-ebfb-4f1a-b927-945b4a5427bf admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 29 20:25:50.870736 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 7/13] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 29 20:25:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:51.357557 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-1e7c08fe-7775-4577-8fe5-608bc5ead6fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "name": "ds2G"}} {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:51.377634 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-1e7c08fe-7775-4577-8fe5-608bc5ead6fe admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.499941 Aug 29 20:25:51.384070 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 7/14] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 29 20:25:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:25:51.393229 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-4d94b4c9-e8f6-4677-8ddd-0512b5aa7ab3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:51.418993 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-4d94b4c9-e8f6-4677-8ddd-0512b5aa7ab3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031706 Aug 29 20:25:51.419916 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 8/15] 10.222.0.18 () {64 vars in 1336 bytes} [Mon Aug 29 20:25:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:25:53.815502 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-1e7c08fe-7775-4577-8fe5-608bc5ead6fe admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:53.816483 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-1e7c08fe-7775-4577-8fe5-608bc5ead6fe admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 29 20:25:53.816884 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 8/16] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 29 20:25:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:54.298721 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-1af424a8-e3c0-405e-8a3f-4d5e5c4354c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096, "vcpus": 4, "disk": 20, "swap": 0, "rxtx_factor": 1.0}} {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:54.326834 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-1af424a8-e3c0-405e-8a3f-4d5e5c4354c7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503155 Aug 29 20:25:54.328004 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 9/17] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 29 20:25:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:25:54.340423 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-2c7fb183-ba6b-4f25-b3c7-8a3680f1eade admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:25:54.366706 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-2c7fb183-ba6b-4f25-b3c7-8a3680f1eade admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029671 Aug 29 20:25:54.367292 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 9/18] 10.222.0.18 () {64 vars in 1336 bytes} [Mon Aug 29 20:25:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:25:57.356391 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-1af424a8-e3c0-405e-8a3f-4d5e5c4354c7 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:57.360411 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-1af424a8-e3c0-405e-8a3f-4d5e5c4354c7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.010633 Aug 29 20:25:57.360828 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 10/19] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 29 20:25:57 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:25:57.858106 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-d6e49678-1703-4570-814d-f88a8d52599a admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:25:57.882661 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-d6e49678-1703-4570-814d-f88a8d52599a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.515519 Aug 29 20:25:57.883136 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 10/20] 10.222.0.18 () {60 vars in 1292 bytes} [Mon Aug 29 20:25:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:26:00.326004 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-1af424a8-e3c0-405e-8a3f-4d5e5c4354c7 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:00.327002 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-1af424a8-e3c0-405e-8a3f-4d5e5c4354c7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 29 20:26:00.327400 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 11/21] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 29 20:26:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:00.821164 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-874f6e3c-cbde-49f8-ace8-5964367e19cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "id": "1", "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0}} {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:00.847722 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-874f6e3c-cbde-49f8-ace8-5964367e19cd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.511455 Aug 29 20:26:00.848718 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 11/22] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 29 20:26:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:26:00.863879 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-82be1cfe-f8fa-40d4-88f4-7176cc3f761e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:00.902743 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-82be1cfe-f8fa-40d4-88f4-7176cc3f761e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043673 Aug 29 20:26:00.903789 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 12/23] 10.222.0.18 () {64 vars in 1333 bytes} [Mon Aug 29 20:26:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:26:03.311665 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-874f6e3c-cbde-49f8-ace8-5964367e19cd admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:03.312758 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-874f6e3c-cbde-49f8-ace8-5964367e19cd admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 29 20:26:03.313160 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 29 20:26:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:03.731323 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-69f0c8e5-63f5-4463-97be-efc21c92cae3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "rxtx_factor": 1.0, "id": "2"}} {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:03.757955 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-69f0c8e5-63f5-4463-97be-efc21c92cae3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.438689 Aug 29 20:26:03.758744 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 13/25] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 29 20:26:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:26:03.771010 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-e064722a-5c25-42f7-821b-9b7b7d6c3aed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:03.794632 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-e064722a-5c25-42f7-821b-9b7b7d6c3aed admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027369 Aug 29 20:26:03.795224 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 13/26] 10.222.0.18 () {64 vars in 1333 bytes} [Mon Aug 29 20:26:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:26:06.207762 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-69f0c8e5-63f5-4463-97be-efc21c92cae3 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:06.208797 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-69f0c8e5-63f5-4463-97be-efc21c92cae3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 29 20:26:06.209282 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 29 20:26:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:06.694691 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-5954c4eb-f4fb-47bd-833b-ef5e43ca0909 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "swap": 0, "vcpus": 2}} {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:06.716358 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-5954c4eb-f4fb-47bd-833b-ef5e43ca0909 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.501002 Aug 29 20:26:06.729936 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-25af507f-ca44-4f34-ac2c-59743f64d93d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:06.734953 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 14/28] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 29 20:26:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:26:06.758928 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-25af507f-ca44-4f34-ac2c-59743f64d93d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030775 Aug 29 20:26:06.759407 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 15/29] 10.222.0.18 () {64 vars in 1333 bytes} [Mon Aug 29 20:26:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:26:09.295663 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-5954c4eb-f4fb-47bd-833b-ef5e43ca0909 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:09.297365 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-5954c4eb-f4fb-47bd-833b-ef5e43ca0909 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 29 20:26:09.298180 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 15/30] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 29 20:26:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:09.769689 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-14dde3c8-f4fd-4f7b-a3b3-18e94e4bee42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:09.780038 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG dbcounter [-] [105383] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:09.796327 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-14dde3c8-f4fd-4f7b-a3b3-18e94e4bee42 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.491675 Aug 29 20:26:09.797822 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 16/31] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 29 20:26:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:26:09.809647 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-f60b5ffd-c602-4917-8e89-26259763df7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:09.844495 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-f60b5ffd-c602-4917-8e89-26259763df7b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037551 Aug 29 20:26:09.845467 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 16/32] 10.222.0.18 () {64 vars in 1333 bytes} [Mon Aug 29 20:26:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:26:12.392493 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-14dde3c8-f4fd-4f7b-a3b3-18e94e4bee42 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:12.393505 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-14dde3c8-f4fd-4f7b-a3b3-18e94e4bee42 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 29 20:26:12.394168 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 17/33] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 29 20:26:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:12.865954 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-4eb8bb45-3b77-4b4b-bb3a-ad42c6ab3e29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "vcpus": 8, "swap": 0, "disk": 160}} {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:12.872321 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG dbcounter [-] [105382] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:12.889325 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-4eb8bb45-3b77-4b4b-bb3a-ad42c6ab3e29 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.488358 Aug 29 20:26:12.890064 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 17/34] 10.222.0.18 () {64 vars in 1283 bytes} [Mon Aug 29 20:26:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:26:12.902991 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-f3cad6b0-5bdf-4162-8e17-715ad4621964 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:12.931235 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-f3cad6b0-5bdf-4162-8e17-715ad4621964 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032502 Aug 29 20:26:12.944569 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 18/35] 10.222.0.18 () {64 vars in 1333 bytes} [Mon Aug 29 20:26:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:26:31.117829 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-4eb8bb45-3b77-4b4b-bb3a-ad42c6ab3e29 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:31.118868 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-4eb8bb45-3b77-4b4b-bb3a-ad42c6ab3e29 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 29 20:26:31.119270 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 18/36] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 29 20:26:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:31.130363 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG dbcounter [-] [105383] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:31.509490 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-fa22b768-0478-4b2a-9eb1-3403a5d7b286 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:31.527883 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-fa22b768-0478-4b2a-9eb1-3403a5d7b286 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401965 Aug 29 20:26:31.528437 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1292 bytes} [Mon Aug 29 20:26:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:26:32.591707 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-4eb8bb45-3b77-4b4b-bb3a-ad42c6ab3e29 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:32.593295 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-4eb8bb45-3b77-4b4b-bb3a-ad42c6ab3e29 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002000 Aug 29 20:26:32.593697 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 29 20:26:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:33.125670 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-e314342b-dbf1-475a-8489-66fffc5984c4 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:33.131394 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.wsgi [None req-e314342b-dbf1-475a-8489-66fffc5984c4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-e314342b-dbf1-475a-8489-66fffc5984c4 admin admin] Request method failure captured: Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Accept: application/json Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Accept-Encoding: gzip, deflate Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Connection: keep-alive Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Content-Length: 0 Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Host: 10.222.0.18 Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Openstack-Api-Version: compute 2.90 Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Openstack-System-Scope: None Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: User-Agent: python-novaclient Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Auth-Token: gAAAAABjDSD4tTYR6TvZqkEvgaiwtjMewgiDHbvg6omLPApARWsTD9DA6mnaMheWcuqXgTMCtwAMxMmLCCrKXJOfE-m206LG9MC_aeqeR4NVQ9DjfM8UC9y7H-MX9W2qubyXMzE6rA0v4vk0JycA2zbmsI9HYwhHIgiQ84xmV8BKot5ez_GK-MI Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Domain-Id: None Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Domain-Name: None Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Identity-Status: Confirmed Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Is-Admin-Project: True Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Project-Domain-Id: default Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Project-Domain-Name: Default Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Project-Id: 31796c851dfa4e61a8e1afef74d31165 Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Project-Name: admin Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Role: reader,admin,member Aug 29 20:26:33.134673 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Roles: reader,admin,member Aug 29 20:26:33.136405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31796c851dfa4e61a8e1afef74d31165"}]}] Aug 29 20:26:33.136405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Tenant: admin Aug 29 20:26:33.136405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Tenant-Id: 31796c851dfa4e61a8e1afef74d31165 Aug 29 20:26:33.136405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Tenant-Name: admin Aug 29 20:26:33.136405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User: admin Aug 29 20:26:33.136405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User-Domain-Id: default Aug 29 20:26:33.136405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User-Domain-Name: Default Aug 29 20:26:33.136405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User-Id: b4cb9e8f0d014047a2ac687139b6261f Aug 29 20:26:33.136405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User-Name: admin Aug 29 20:26:33.136405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: method: > Aug 29 20:26:33.136405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: exception: Flavor 42 could not be found. Aug 29 20:26:33.136405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: action_args: {'id': '42'} Aug 29 20:26:33.136405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:26:33.136405 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:33.137482 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:33.138959 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-e314342b-dbf1-475a-8489-66fffc5984c4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:26:33.140867 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-e314342b-dbf1-475a-8489-66fffc5984c4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.385713 Aug 29 20:26:33.140867 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Aug 29 20:26:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:33.146752 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-4499c303-10ee-44e7-b2a8-9c8492aee888 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:33.169251 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-4499c303-10ee-44e7-b2a8-9c8492aee888 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026291 Aug 29 20:26:33.169729 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Aug 29 20:26:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:26:33.179264 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-d6461ef4-cff1-4f96-b529-932ae86412d2 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:33.203832 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-d6461ef4-cff1-4f96-b529-932ae86412d2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028078 Aug 29 20:26:33.204407 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Aug 29 20:26:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:26:33.213861 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-417147f2-4e43-4a42-b0c6-1d103c3a32cd admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:33.219343 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.wsgi [None req-417147f2-4e43-4a42-b0c6-1d103c3a32cd admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-417147f2-4e43-4a42-b0c6-1d103c3a32cd admin admin] Request method failure captured: Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Accept: application/json Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Accept-Encoding: gzip, deflate Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Connection: keep-alive Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Content-Length: 0 Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Host: 10.222.0.18 Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Openstack-Api-Version: compute 2.90 Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Openstack-System-Scope: None Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: User-Agent: python-novaclient Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Auth-Token: gAAAAABjDSD4tTYR6TvZqkEvgaiwtjMewgiDHbvg6omLPApARWsTD9DA6mnaMheWcuqXgTMCtwAMxMmLCCrKXJOfE-m206LG9MC_aeqeR4NVQ9DjfM8UC9y7H-MX9W2qubyXMzE6rA0v4vk0JycA2zbmsI9HYwhHIgiQ84xmV8BKot5ez_GK-MI Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Domain-Id: None Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Domain-Name: None Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Identity-Status: Confirmed Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Is-Admin-Project: True Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Project-Domain-Id: default Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Project-Domain-Name: Default Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Project-Id: 31796c851dfa4e61a8e1afef74d31165 Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Project-Name: admin Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Role: reader,admin,member Aug 29 20:26:33.222593 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Roles: reader,admin,member Aug 29 20:26:33.224151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31796c851dfa4e61a8e1afef74d31165"}]}] Aug 29 20:26:33.224151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Tenant: admin Aug 29 20:26:33.224151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Tenant-Id: 31796c851dfa4e61a8e1afef74d31165 Aug 29 20:26:33.224151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Tenant-Name: admin Aug 29 20:26:33.224151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User: admin Aug 29 20:26:33.224151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User-Domain-Id: default Aug 29 20:26:33.224151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User-Domain-Name: Default Aug 29 20:26:33.224151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User-Id: b4cb9e8f0d014047a2ac687139b6261f Aug 29 20:26:33.224151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User-Name: admin Aug 29 20:26:33.224151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: method: > Aug 29 20:26:33.224151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: exception: Flavor 42 could not be found. Aug 29 20:26:33.224151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: action_args: {'id': '42'} Aug 29 20:26:33.224151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:26:33.224151 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:33.225118 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:33.226397 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-417147f2-4e43-4a42-b0c6-1d103c3a32cd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:26:33.227606 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-417147f2-4e43-4a42-b0c6-1d103c3a32cd admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013835 Aug 29 20:26:33.227606 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Aug 29 20:26:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:34.191759 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-d6461ef4-cff1-4f96-b529-932ae86412d2 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:34.192825 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-d6461ef4-cff1-4f96-b529-932ae86412d2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 29 20:26:34.193217 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 22/43] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 29 20:26:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:34.726553 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-a940dfaa-85bf-4749-9ce6-8e0eaea441e3 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:34.732430 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.wsgi [None req-a940dfaa-85bf-4749-9ce6-8e0eaea441e3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-a940dfaa-85bf-4749-9ce6-8e0eaea441e3 admin admin] Request method failure captured: Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Accept: application/json Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Accept-Encoding: gzip, deflate Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Connection: keep-alive Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Content-Length: 0 Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Host: 10.222.0.18 Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Openstack-Api-Version: compute 2.90 Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Openstack-System-Scope: None Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: User-Agent: python-novaclient Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Auth-Token: gAAAAABjDSD6U6IxtyLjydgmgHa6UbX21MkLBEzr0nJ9OPkiZGN3itS8R249xOHvmGRJXoeAGzm2m8w_dMV2B9-YE6xovR9lh-73RNQjcHYpBjlvM9ENVZakWvdfVs-nd-Z1GxjmugSDEw8SgBqYSgsSp2Tam8Uuzh-K2P-wkWMNaxGbiw-GU0Q Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Domain-Id: None Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Domain-Name: None Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Identity-Status: Confirmed Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Is-Admin-Project: True Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Project-Domain-Id: default Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Project-Domain-Name: Default Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Project-Id: 31796c851dfa4e61a8e1afef74d31165 Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Project-Name: admin Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Role: reader,admin,member Aug 29 20:26:34.734576 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Roles: reader,admin,member Aug 29 20:26:34.736797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31796c851dfa4e61a8e1afef74d31165"}]}] Aug 29 20:26:34.736797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Tenant: admin Aug 29 20:26:34.736797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Tenant-Id: 31796c851dfa4e61a8e1afef74d31165 Aug 29 20:26:34.736797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Tenant-Name: admin Aug 29 20:26:34.736797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User: admin Aug 29 20:26:34.736797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User-Domain-Id: default Aug 29 20:26:34.736797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User-Domain-Name: Default Aug 29 20:26:34.736797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User-Id: b4cb9e8f0d014047a2ac687139b6261f Aug 29 20:26:34.736797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User-Name: admin Aug 29 20:26:34.736797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: method: > Aug 29 20:26:34.736797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: exception: Flavor 84 could not be found. Aug 29 20:26:34.736797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: action_args: {'id': '84'} Aug 29 20:26:34.736797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:26:34.736797 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:34.737866 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.739408 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-a940dfaa-85bf-4749-9ce6-8e0eaea441e3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:26:34.740816 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-a940dfaa-85bf-4749-9ce6-8e0eaea441e3 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.392879 Aug 29 20:26:34.740816 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Aug 29 20:26:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:34.746429 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-06b966f4-d459-4015-9b3d-42442b6f98af admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:34.762049 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-06b966f4-d459-4015-9b3d-42442b6f98af admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019198 Aug 29 20:26:34.762615 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Aug 29 20:26:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:26:34.772111 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-8f030eb5-7deb-4814-ad6c-4b510d61f516 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:34.788687 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-8f030eb5-7deb-4814-ad6c-4b510d61f516 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020103 Aug 29 20:26:34.789469 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Aug 29 20:26:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:26:34.799217 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-9eb10bad-85af-412f-9a8b-95de59cbaa0e admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:34.804531 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.wsgi [None req-9eb10bad-85af-412f-9a8b-95de59cbaa0e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-9eb10bad-85af-412f-9a8b-95de59cbaa0e admin admin] Request method failure captured: Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Accept: application/json Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Accept-Encoding: gzip, deflate Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Connection: keep-alive Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Content-Length: 0 Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Host: 10.222.0.18 Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Openstack-Api-Version: compute 2.90 Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Openstack-System-Scope: None Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: User-Agent: python-novaclient Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Auth-Token: gAAAAABjDSD6U6IxtyLjydgmgHa6UbX21MkLBEzr0nJ9OPkiZGN3itS8R249xOHvmGRJXoeAGzm2m8w_dMV2B9-YE6xovR9lh-73RNQjcHYpBjlvM9ENVZakWvdfVs-nd-Z1GxjmugSDEw8SgBqYSgsSp2Tam8Uuzh-K2P-wkWMNaxGbiw-GU0Q Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Domain-Id: None Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Domain-Name: None Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Identity-Status: Confirmed Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Is-Admin-Project: True Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Project-Domain-Id: default Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Project-Domain-Name: Default Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Project-Id: 31796c851dfa4e61a8e1afef74d31165 Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Project-Name: admin Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Role: reader,admin,member Aug 29 20:26:34.806001 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Roles: reader,admin,member Aug 29 20:26:34.807685 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31796c851dfa4e61a8e1afef74d31165"}]}] Aug 29 20:26:34.807685 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Tenant: admin Aug 29 20:26:34.807685 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Tenant-Id: 31796c851dfa4e61a8e1afef74d31165 Aug 29 20:26:34.807685 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Tenant-Name: admin Aug 29 20:26:34.807685 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User: admin Aug 29 20:26:34.807685 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User-Domain-Id: default Aug 29 20:26:34.807685 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User-Domain-Name: Default Aug 29 20:26:34.807685 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User-Id: b4cb9e8f0d014047a2ac687139b6261f Aug 29 20:26:34.807685 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User-Name: admin Aug 29 20:26:34.807685 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: method: > Aug 29 20:26:34.807685 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: exception: Flavor 84 could not be found. Aug 29 20:26:34.807685 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: action_args: {'id': '84'} Aug 29 20:26:34.807685 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:26:34.807685 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:34.808754 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:34.810073 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-9eb10bad-85af-412f-9a8b-95de59cbaa0e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:26:34.811859 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-9eb10bad-85af-412f-9a8b-95de59cbaa0e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012255 Aug 29 20:26:34.811859 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 24/47] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Aug 29 20:26:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:35.783483 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-8f030eb5-7deb-4814-ad6c-4b510d61f516 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:35.784554 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-8f030eb5-7deb-4814-ad6c-4b510d61f516 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 29 20:26:35.784951 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 24/48] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 29 20:26:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:36.302834 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-c207187b-f26d-4371-baea-73cf9e919989 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:36.308671 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.wsgi [None req-c207187b-f26d-4371-baea-73cf9e919989 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-c207187b-f26d-4371-baea-73cf9e919989 admin admin] Request method failure captured: Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Accept: application/json Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Accept-Encoding: gzip, deflate Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Connection: keep-alive Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Content-Length: 0 Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Host: 10.222.0.18 Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Openstack-Api-Version: compute 2.90 Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Openstack-System-Scope: None Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: User-Agent: python-novaclient Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Auth-Token: gAAAAABjDSD7KJ8EFsvkHeBvs1TwooTNuGOzTCmNaUruon3_ReHOAczz8EwcF--_eoyj_4zyRKE2gAkrTdYYwvl-evNcwWqjT69Tq4j-L9tvjM-qhdpJMBmnGWHMJC7wgJdb7aealMw1-xpzr-hCPuHjR5mk9R6qiBRN4irB7aQ6vJaaL93Q7_8 Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Domain-Id: None Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Domain-Name: None Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Identity-Status: Confirmed Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Is-Admin-Project: True Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Project-Domain-Id: default Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Project-Domain-Name: Default Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Project-Id: 31796c851dfa4e61a8e1afef74d31165 Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Project-Name: admin Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Role: reader,admin,member Aug 29 20:26:36.310164 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Roles: reader,admin,member Aug 29 20:26:36.312353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31796c851dfa4e61a8e1afef74d31165"}]}] Aug 29 20:26:36.312353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Tenant: admin Aug 29 20:26:36.312353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Tenant-Id: 31796c851dfa4e61a8e1afef74d31165 Aug 29 20:26:36.312353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-Tenant-Name: admin Aug 29 20:26:36.312353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User: admin Aug 29 20:26:36.312353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User-Domain-Id: default Aug 29 20:26:36.312353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User-Domain-Name: Default Aug 29 20:26:36.312353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User-Id: b4cb9e8f0d014047a2ac687139b6261f Aug 29 20:26:36.312353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: X-User-Name: admin Aug 29 20:26:36.312353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: method: > Aug 29 20:26:36.312353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: exception: Flavor 451 could not be found. Aug 29 20:26:36.312353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: action_args: {'id': '451'} Aug 29 20:26:36.312353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:26:36.312353 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:36.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: ERROR nova.api.openstack.wsgi Aug 29 20:26:36.314860 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-c207187b-f26d-4371-baea-73cf9e919989 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:26:36.316159 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-c207187b-f26d-4371-baea-73cf9e919989 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388303 Aug 29 20:26:36.316159 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 25/49] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Aug 29 20:26:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:36.321705 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-c0d6f3e2-0320-4f3d-a9b6-81c0d9e4ec89 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:36.336441 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-c0d6f3e2-0320-4f3d-a9b6-81c0d9e4ec89 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018193 Aug 29 20:26:36.336987 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 25/50] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Aug 29 20:26:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:26:36.346603 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-f3ca55c2-aac0-4785-a658-cea20d49368e admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:36.361964 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-f3ca55c2-aac0-4785-a658-cea20d49368e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018989 Aug 29 20:26:36.362478 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 26/51] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Aug 29 20:26:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:26:36.371558 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-a21a1930-1486-43f4-a574-43be2165338e admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:36.377569 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.wsgi [None req-a21a1930-1486-43f4-a574-43be2165338e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-a21a1930-1486-43f4-a574-43be2165338e admin admin] Request method failure captured: Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Accept: application/json Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Accept-Encoding: gzip, deflate Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Connection: keep-alive Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Content-Length: 0 Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Host: 10.222.0.18 Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Openstack-Api-Version: compute 2.90 Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Openstack-System-Scope: None Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: User-Agent: python-novaclient Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Auth-Token: gAAAAABjDSD7KJ8EFsvkHeBvs1TwooTNuGOzTCmNaUruon3_ReHOAczz8EwcF--_eoyj_4zyRKE2gAkrTdYYwvl-evNcwWqjT69Tq4j-L9tvjM-qhdpJMBmnGWHMJC7wgJdb7aealMw1-xpzr-hCPuHjR5mk9R6qiBRN4irB7aQ6vJaaL93Q7_8 Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Domain-Id: None Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Domain-Name: None Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Identity-Status: Confirmed Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Is-Admin-Project: True Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Project-Domain-Id: default Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Project-Domain-Name: Default Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Project-Id: 31796c851dfa4e61a8e1afef74d31165 Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Project-Name: admin Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Role: reader,admin,member Aug 29 20:26:36.379044 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Roles: reader,admin,member Aug 29 20:26:36.380737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31796c851dfa4e61a8e1afef74d31165"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31796c851dfa4e61a8e1afef74d31165"}]}] Aug 29 20:26:36.380737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Tenant: admin Aug 29 20:26:36.380737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Tenant-Id: 31796c851dfa4e61a8e1afef74d31165 Aug 29 20:26:36.380737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-Tenant-Name: admin Aug 29 20:26:36.380737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User: admin Aug 29 20:26:36.380737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User-Domain-Id: default Aug 29 20:26:36.380737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User-Domain-Name: Default Aug 29 20:26:36.380737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User-Id: b4cb9e8f0d014047a2ac687139b6261f Aug 29 20:26:36.380737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: X-User-Name: admin Aug 29 20:26:36.380737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: method: > Aug 29 20:26:36.380737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: exception: Flavor 451 could not be found. Aug 29 20:26:36.380737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: action_args: {'id': '451'} Aug 29 20:26:36.380737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:26:36.380737 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:36.381639 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: ERROR nova.api.openstack.wsgi Aug 29 20:26:36.382873 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-a21a1930-1486-43f4-a574-43be2165338e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:26:36.383893 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-a21a1930-1486-43f4-a574-43be2165338e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012386 Aug 29 20:26:36.383893 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 26/52] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Aug 29 20:26:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:37.361427 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-f3ca55c2-aac0-4785-a658-cea20d49368e admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:37.362435 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-f3ca55c2-aac0-4785-a658-cea20d49368e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 29 20:26:37.362817 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 29 20:26:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:37.884721 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-47240fd2-b7dd-4364-8351-d746b37587b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:37.905551 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-47240fd2-b7dd-4364-8351-d746b37587b7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.407114 Aug 29 20:26:37.906106 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 27/54] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Aug 29 20:26:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:26:38.896245 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-f3ca55c2-aac0-4785-a658-cea20d49368e admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:38.897246 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-f3ca55c2-aac0-4785-a658-cea20d49368e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 29 20:26:38.897643 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 29 20:26:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:39.415913 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-8d49720d-f7e1-4b42-8d1a-f6191fde875a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:39.434651 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-8d49720d-f7e1-4b42-8d1a-f6191fde875a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.400181 Aug 29 20:26:39.435194 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 28/56] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Aug 29 20:26:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:26:40.425004 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-f3ca55c2-aac0-4785-a658-cea20d49368e admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:40.426012 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-f3ca55c2-aac0-4785-a658-cea20d49368e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 29 20:26:40.426410 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 29/57] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 29 20:26:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:40.963133 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-98d2e2e3-bfb0-4328-96ef-2ecb775b6dc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:40.981312 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-98d2e2e3-bfb0-4328-96ef-2ecb775b6dc6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.413536 Aug 29 20:26:40.981851 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 29/58] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Aug 29 20:26:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:26:41.964659 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-f3ca55c2-aac0-4785-a658-cea20d49368e admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:41.965753 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-f3ca55c2-aac0-4785-a658-cea20d49368e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 29 20:26:41.966157 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 30/59] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 29 20:26:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:42.495191 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-d7bbe3fd-c270-48fd-9020-3fee4ae39d75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:26:42.514519 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-d7bbe3fd-c270-48fd-9020-3fee4ae39d75 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.407424 Aug 29 20:26:42.515066 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 30/60] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Aug 29 20:26:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:26:43.479821 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-f3ca55c2-aac0-4785-a658-cea20d49368e admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:43.480871 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-f3ca55c2-aac0-4785-a658-cea20d49368e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 29 20:26:43.481297 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 31/61] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 29 20:26:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:26:43.999743 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-4c2c8cf3-3a04-4751-b8ce-c3e240a4db97 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:26:44.020077 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-4c2c8cf3-3a04-4751-b8ce-c3e240a4db97 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.400772 Aug 29 20:26:44.020603 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 31/62] 10.222.0.18 () {60 vars in 1202 bytes} [Mon Aug 29 20:26:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:27:37.543033 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-f3ca55c2-aac0-4785-a658-cea20d49368e admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:37.544080 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-f3ca55c2-aac0-4785-a658-cea20d49368e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 29 20:27:37.544485 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 32/63] 10.222.0.18 () {54 vars in 931 bytes} [Mon Aug 29 20:27:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:27:37.554881 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG dbcounter [-] [105382] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:37.934720 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-e60ad514-62eb-42ed-bfde-b0dddff3b725 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:37.954836 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-e60ad514-62eb-42ed-bfde-b0dddff3b725 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404363 Aug 29 20:27:37.955375 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 32/64] 10.222.0.18 () {60 vars in 1292 bytes} [Mon Aug 29 20:27:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:27:37.976067 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG dbcounter [-] [105383] Writing DB stats nova_api:SELECT=14 {{(pid=105383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:37.980239 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-2c7f12c1-4306-4fa9-a651-1b8830c4fabf admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:37.987751 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-2c7f12c1-4306-4fa9-a651-1b8830c4fabf admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013127 Aug 29 20:27:37.988308 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 33/65] 10.222.0.18 () {60 vars in 1283 bytes} [Mon Aug 29 20:27:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:38.001095 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-0c47d561-2dff-4e60-9d0d-3845fc3ac305 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:38.008750 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-0c47d561-2dff-4e60-9d0d-3845fc3ac305 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011236 Aug 29 20:27:38.009266 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 33/66] 10.222.0.18 () {60 vars in 1286 bytes} [Mon Aug 29 20:27:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:27:38.020458 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-4a816e80-f288-42a5-b844-35eb91e437b0 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:38.028718 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-4a816e80-f288-42a5-b844-35eb91e437b0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011803 Aug 29 20:27:38.029236 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 34/67] 10.222.0.18 () {60 vars in 1286 bytes} [Mon Aug 29 20:27:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:27:38.040667 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-aa026c26-b69e-4af7-bdfa-95d5cc7f4d10 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:27:38.049932 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-aa026c26-b69e-4af7-bdfa-95d5cc7f4d10 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012775 Aug 29 20:27:38.050450 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1283 bytes} [Mon Aug 29 20:27:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:30:45.915152 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-4a816e80-f288-42a5-b844-35eb91e437b0 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:45.915889 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-4a816e80-f288-42a5-b844-35eb91e437b0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001673 Aug 29 20:30:45.916351 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 35/69] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 29 20:30:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:30:46.058003 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG dbcounter [-] [105382] Writing DB stats nova_api:SELECT=6 {{(pid=105382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:46.256600 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-8f46bd85-0bcb-4e9b-af78-f6974440e912 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:46.260688 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-8f46bd85-0bcb-4e9b-af78-f6974440e912 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:46.261162 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-8f46bd85-0bcb-4e9b-af78-f6974440e912 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:46.261592 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-8f46bd85-0bcb-4e9b-af78-f6974440e912 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:46.262294 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-8f46bd85-0bcb-4e9b-af78-f6974440e912 admin admin] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:46.262736 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-8f46bd85-0bcb-4e9b-af78-f6974440e912 admin admin] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:46.263171 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-8f46bd85-0bcb-4e9b-af78-f6974440e912 admin admin] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:46.299556 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-8f46bd85-0bcb-4e9b-af78-f6974440e912 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.242843 Aug 29 20:30:46.312211 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 35/70] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Aug 29 20:30:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:30:47.154837 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-4a816e80-f288-42a5-b844-35eb91e437b0 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:47.155849 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-4a816e80-f288-42a5-b844-35eb91e437b0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 29 20:30:47.156296 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 29 20:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:30:47.355730 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-754ace9a-a34f-4b7b-96d5-abaf3a54a9cd admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:47.360623 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-754ace9a-a34f-4b7b-96d5-abaf3a54a9cd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:47.361196 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-754ace9a-a34f-4b7b-96d5-abaf3a54a9cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:47.361650 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-754ace9a-a34f-4b7b-96d5-abaf3a54a9cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:47.362380 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-754ace9a-a34f-4b7b-96d5-abaf3a54a9cd admin admin] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:47.362830 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-754ace9a-a34f-4b7b-96d5-abaf3a54a9cd admin admin] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:47.363248 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-754ace9a-a34f-4b7b-96d5-abaf3a54a9cd admin admin] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:47.384040 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-754ace9a-a34f-4b7b-96d5-abaf3a54a9cd admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085670 Aug 29 20:30:47.385544 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 36/72] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Aug 29 20:30:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:30:58.578564 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-4a816e80-f288-42a5-b844-35eb91e437b0 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:58.579570 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-4a816e80-f288-42a5-b844-35eb91e437b0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 29 20:30:58.579996 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 29 20:30:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:30:58.745022 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG dbcounter [-] [105382] Writing DB stats nova_cell0:SELECT=4 {{(pid=105382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:58.745751 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG dbcounter [-] [105382] Writing DB stats nova_cell1:SELECT=4 {{(pid=105382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:58.746357 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG dbcounter [-] [105382] Writing DB stats nova_api:SELECT=8 {{(pid=105382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:58.796036 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-13c755c2-dfd8-4c46-b968-0353e16b9379 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:58.799340 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-13c755c2-dfd8-4c46-b968-0353e16b9379 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:58.799804 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-13c755c2-dfd8-4c46-b968-0353e16b9379 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:58.800318 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-13c755c2-dfd8-4c46-b968-0353e16b9379 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:58.801145 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-13c755c2-dfd8-4c46-b968-0353e16b9379 admin admin] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:58.801583 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-13c755c2-dfd8-4c46-b968-0353e16b9379 admin admin] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:58.801994 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-13c755c2-dfd8-4c46-b968-0353e16b9379 admin admin] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:58.828208 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-13c755c2-dfd8-4c46-b968-0353e16b9379 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087790 Aug 29 20:30:58.829040 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 37/74] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Aug 29 20:30:58 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:30:59.668920 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: DEBUG nova.api.openstack.wsgi [None req-4a816e80-f288-42a5-b844-35eb91e437b0 admin admin] Calling method '>' {{(pid=105383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:59.669916 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: INFO nova.api.openstack.requestlog [None req-4a816e80-f288-42a5-b844-35eb91e437b0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 29 20:30:59.670309 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: [pid: 105383|app: 0|req: 38/75] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Aug 29 20:30:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:30:59.873328 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG nova.api.openstack.wsgi [None req-16a5cd2b-8cd3-43ac-a68a-1b18790b5825 admin admin] Calling method '>' {{(pid=105382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:30:59.876761 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-16a5cd2b-8cd3-43ac-a68a-1b18790b5825 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:59.877186 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-16a5cd2b-8cd3-43ac-a68a-1b18790b5825 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:59.877613 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-16a5cd2b-8cd3-43ac-a68a-1b18790b5825 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:59.878380 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-16a5cd2b-8cd3-43ac-a68a-1b18790b5825 admin admin] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:30:59.878823 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-16a5cd2b-8cd3-43ac-a68a-1b18790b5825 admin admin] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:30:59.879239 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: DEBUG oslo_concurrency.lockutils [None req-16a5cd2b-8cd3-43ac-a68a-1b18790b5825 admin admin] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:30:59.901666 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: INFO nova.api.openstack.requestlog [None req-16a5cd2b-8cd3-43ac-a68a-1b18790b5825 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079571 Aug 29 20:30:59.902226 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: [pid: 105382|app: 0|req: 38/76] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Aug 29 20:30:59 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:32:03.098932 dv-cinder-854263-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 20:32:03.099470 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: Mon Aug 29 20:32:03 2022 - graceful shutdown triggered... Aug 29 20:32:03.099889 dv-cinder-854263-2-iscsi devstack@n-api.service[105383]: Gracefully killing worker 2 (pid: 105383)... Aug 29 20:32:03.100270 dv-cinder-854263-2-iscsi devstack@n-api.service[105382]: Gracefully killing worker 1 (pid: 105382)... Aug 29 20:32:04.100619 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: worker 1 buried after 1 seconds Aug 29 20:32:04.101175 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: worker 2 buried after 1 seconds Aug 29 20:32:04.101175 dv-cinder-854263-2-iscsi devstack@n-api.service[105381]: goodbye to uWSGI. Aug 29 20:32:04.102205 dv-cinder-854263-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 20:32:04.102746 dv-cinder-854263-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 20:32:04.105647 dv-cinder-854263-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 20:32:04.115273 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 20:32:04.117293 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 20:32:04 2022] *** Aug 29 20:32:04.117293 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 20:32:04.117293 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 20:32:04.117293 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: nodename: dv-cinder-854263-2-iscsi Aug 29 20:32:04.117293 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: machine: x86_64 Aug 29 20:32:04.117293 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: clock source: unix Aug 29 20:32:04.117293 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: pcre jit disabled Aug 29 20:32:04.117293 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: detected number of CPU cores: 4 Aug 29 20:32:04.117293 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: current working directory: / Aug 29 20:32:04.117293 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: detected binary path: /usr/bin/uwsgi-core Aug 29 20:32:04.117293 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: your processes number limit is 47680 Aug 29 20:32:04.118103 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: your memory page size is 4096 bytes Aug 29 20:32:04.118103 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: detected max file descriptor number: 2048 Aug 29 20:32:04.118103 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: lock engine: pthread robust mutexes Aug 29 20:32:04.118103 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: thunder lock: enabled Aug 29 20:32:04.118103 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 20:32:04.118103 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 20:32:04.156920 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: Python main interpreter initialized at 0x5648a5fea9c0 Aug 29 20:32:04.156920 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: python threads support enabled Aug 29 20:32:04.156920 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: your server socket listen backlog is limited to 100 connections Aug 29 20:32:04.156920 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: your mercy for graceful operations on workers is 90 seconds Aug 29 20:32:04.157419 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 20:32:04.157419 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: *** Operational MODE: preforking *** Aug 29 20:32:04.158181 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: *** uWSGI is running in multiple interpreter mode *** Aug 29 20:32:04.158350 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: spawned uWSGI master process (pid: 127011) Aug 29 20:32:04.158689 dv-cinder-854263-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 20:32:04.160903 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: spawned uWSGI worker 1 (pid: 127027, cores: 1) Aug 29 20:32:04.160903 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: spawned uWSGI worker 2 (pid: 127028, cores: 1) Aug 29 20:32:04.160903 dv-cinder-854263-2-iscsi devstack@n-api.service[127011]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 20:32:04.827695 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:32:04.832270 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 20:32:06.006941 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:32:06.006941 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: from cryptography.utils import int_from_bytes Aug 29 20:32:06.007577 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:32:06.007577 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: from cryptography.utils import int_from_bytes Aug 29 20:32:06.032857 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:32:06.032857 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: from cryptography.utils import int_from_bytes Aug 29 20:32:06.033499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:32:06.033499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: from cryptography.utils import int_from_bytes Aug 29 20:32:08.412634 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:32:08.413210 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:32:08.413478 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:32:08.413708 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:32:08.413972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:32:08.414355 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.414685 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.415013 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.415335 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.415820 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.416163 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.416490 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.416812 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.417147 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.417410 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.417730 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.418054 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854263-2-iscsi {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.418379 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.418690 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.419002 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.419324 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.419630 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.419966 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.420345 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.420773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.422132 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.422132 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.422335 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.422559 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.422883 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.423196 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.423517 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.423842 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.424205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.425107 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.425483 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854263-2-iscsi {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.425808 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.426127 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.426446 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.426950 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.427271 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.427596 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.427914 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.428265 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.428578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.428908 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.429230 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.429550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.429871 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.430192 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.430492 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.430812 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.431135 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.431448 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.431761 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.432045 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.432360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.432684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.433005 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.433330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.433584 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.433836 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.434153 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.434474 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.434786 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.435023 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:32:08.435459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.435541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:32:08.435620 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.435697 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.435914 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:32:08.436055 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.436165 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:32:08.436337 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.436451 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:32:08.436629 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.436805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.436907 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.437122 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.437233 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.437446 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.437553 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.437765 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.437924 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.438139 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.438300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.438443 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.438585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.438847 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.439015 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.439166 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.439308 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.439468 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.439621 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.439773 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.439964 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.440710 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.440888 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.441048 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.441257 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854263-2-iscsi {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.441425 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.441596 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.441746 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.441895 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.442049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.442202 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.442351 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.442507 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.442651 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.442803 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.442953 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.443103 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.443255 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.443416 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.443559 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.443559 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.443851 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.444056 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.444264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.444425 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.444575 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.444718 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.444860 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.445001 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.445164 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.445322 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.445465 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.445614 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.445764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.445930 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.446081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.446475 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.446660 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.446808 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.447228 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.447407 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.447632 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.447903 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.448375 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854263-2-iscsi {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.448534 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.448696 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.448849 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.449084 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.449242 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.449394 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.449547 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.449547 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.450438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.450584 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.450727 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.450888 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.451124 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.451269 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.451412 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.451564 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.451707 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.451857 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.452171 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.452341 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.452630 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.452795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.453011 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.453201 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.453201 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.453523 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.453680 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.453868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.454021 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.454281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.454433 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.454577 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.454725 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.454877 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.454877 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.455168 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.455368 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.455523 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.455684 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.456726 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.456896 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.457060 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.457575 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.457778 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.457942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.458088 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.458438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.458596 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.458740 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.458948 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.459128 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.459371 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.459598 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.459761 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.460000 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.460167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.460320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.460464 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.460615 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.460764 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.460764 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.461078 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.461227 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.461377 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.461556 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.461556 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.461556 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.461556 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.462183 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.462338 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.462527 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.462680 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.462832 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.462994 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.463145 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.463287 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.463435 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.463435 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.463823 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.464000 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.464188 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.464188 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.464538 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.464727 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.464883 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.465040 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.465194 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.465336 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.465488 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.465660 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.465906 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.466064 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.466209 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.466394 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.466554 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.466894 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.467057 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.467203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.467705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.467902 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.468081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.468250 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.468609 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.468760 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.468903 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.469056 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.469201 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.469377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.469611 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.469764 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.469956 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.469956 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.470251 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.470403 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.470546 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.470687 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.470687 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.470971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.471128 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.471128 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.471743 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.471968 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.471968 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.472262 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.472460 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.472460 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.472745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.472888 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.472888 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.473156 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.473308 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.473308 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.473586 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.473733 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.473733 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.474073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.474237 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.474442 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.474600 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.474600 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.474881 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.475040 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.475040 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.475318 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.475467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.475467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.475745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.475962 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.475962 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.476265 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.476425 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.476425 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.476778 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.477087 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.477087 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.477365 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.477539 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.477539 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.478130 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.478288 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.478288 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.478720 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.478896 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.478896 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.479184 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.479326 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.479326 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.479628 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.479862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.479862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.480211 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.480364 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.480364 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.480682 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.480840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.480840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.481227 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.481378 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.481378 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.481664 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.481808 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.481808 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.482141 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.482299 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.482299 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.482585 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.482742 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.482897 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.483051 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.483051 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.483481 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.483638 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:32:08.483638 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.483956 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.484118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.484118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.484398 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.484584 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.484770 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.484918 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.485076 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.485218 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.485361 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.485502 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.485502 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.485787 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.485937 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.485937 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.486253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.486411 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.486411 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.486712 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.486855 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.486855 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.487347 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.487507 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.487507 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.487806 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.488393 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.488393 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.488896 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.489061 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.489061 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.489342 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.489486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.489486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.489775 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.490049 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.490049 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.490411 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.490563 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.490707 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.490859 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.490859 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.491131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.491303 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.491303 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.492273 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.492446 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.492446 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.492782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.492932 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.493085 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.493236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.493236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.493631 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.493789 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.493932 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.494074 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.494216 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.494373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.494631 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.494792 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.494973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.495127 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.495282 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.495282 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.495562 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.495712 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.495886 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.496103 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.496103 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.496581 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.496733 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.496733 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.497025 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.497188 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.497437 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.497595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.497751 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.497894 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.498173 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.498558 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.498722 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.498885 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.499874 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.500073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.500341 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.500512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.500665 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.500852 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.501099 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.501265 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.501468 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.501624 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.501769 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.501920 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.502070 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.502213 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.502363 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.502555 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.503877 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.504087 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.504234 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.504408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.504582 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.504779 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.504779 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.505077 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.505228 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.505370 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.505527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.505690 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.505835 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.505985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.506128 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.506278 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.506430 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.506621 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.506785 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.506937 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.507089 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.510642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.510836 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.510993 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.511153 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.511300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.511444 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.511594 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.511753 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.511907 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.512086 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.512233 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.512387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.512580 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.512730 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.512873 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.513016 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.513184 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.513331 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.513489 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.513656 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.513770 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.513868 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.513958 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.514048 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.514149 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.514235 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.514325 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.514408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.514486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.514563 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.514810 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.514895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.514977 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.515056 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.515133 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.515213 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.515285 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.515354 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.515422 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.515496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.515576 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.515655 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.515733 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.515813 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.515890 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.515982 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.516058 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.516215 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.516215 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.516353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.516353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.516486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.516556 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.516642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.516721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.516792 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.516792 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.516792 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.516792 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.516792 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.517110 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.517202 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.517280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.517358 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.517436 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.517514 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.517583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.517660 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.517736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.517807 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.517888 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.518001 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.518091 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.518170 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.518282 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.518388 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.518985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.519065 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.519136 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.519205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.519279 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.519349 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.519427 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.519505 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.519575 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.519662 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.520205 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.520302 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.520382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.520480 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.520559 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.520630 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.520705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.520791 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.520862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.520931 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.521007 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.521084 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.521163 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.521247 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.521318 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.521469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.521610 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.521761 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.522052 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.522148 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.522379 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.522466 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.522712 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.522809 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.522998 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.523089 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.523318 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.523404 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.523626 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.523706 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.524000 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.524106 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.524256 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.524353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.524572 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.524672 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.524878 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.524979 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.525186 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.525268 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.525506 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.525617 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.525832 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.526138 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.526225 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.526546 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.526647 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.526878 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.526960 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.527269 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.527358 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.527597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.527796 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.527917 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.528374 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.528580 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.528747 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.528899 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.529066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.529237 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.529479 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.529643 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.530501 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.530672 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.530866 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.530866 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.531177 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.531338 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.531338 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.531726 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.531883 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.531883 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.532258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.532415 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.532693 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.532860 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.533031 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.533299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.533457 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.533614 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.534428 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.534602 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.534763 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.535052 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.535219 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.535379 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.535594 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.535752 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.535916 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.536241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.536410 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.536561 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.536832 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.536990 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.537150 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.537445 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.537611 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.537769 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.538039 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.538211 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.538378 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.538696 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.538894 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.539048 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.539225 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.539393 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.539545 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.539843 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.540082 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.540706 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.540867 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.541027 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.541027 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.541349 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.541507 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.541658 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.541897 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.542070 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.542230 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.542386 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.542638 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.542804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.543193 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.543355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.543511 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.543669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.543882 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.544225 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.544414 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.544655 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.544844 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.545122 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.545281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.545464 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.545642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.545795 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.546045 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.546202 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.546375 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.546544 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.546705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.546891 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.547055 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.547285 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.547441 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.547599 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.547905 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.548136 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.548288 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.548548 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.548705 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.548854 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.549152 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.549308 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.549502 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.550324 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.551433 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.551600 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.551790 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.551790 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.552271 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.552426 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.552426 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.552712 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.552871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.553029 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.553196 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.553196 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.553498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.553662 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.553662 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.553946 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.554106 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.554257 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.554412 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.554576 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.554763 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.554956 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.555223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.555380 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.555528 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.555693 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.555872 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.556059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.556210 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.556384 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.556543 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.556707 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.556866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.557023 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.557174 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.557322 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.557478 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.557637 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.557787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.557943 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.558093 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.558242 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.558411 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.558577 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.558734 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.558892 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.559042 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.559191 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.559392 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.559545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.559702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.559852 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.560055 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.560219 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.560379 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.560543 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.561095 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.561271 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.561450 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.561703 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.561859 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.562010 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.562254 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.562420 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.562573 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.562813 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.563011 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.563179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.563337 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.563495 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.563495 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.563805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.563975 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.564130 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.564292 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.564443 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.564708 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.564967 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.565403 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.565639 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.565883 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.566049 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.566216 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.566376 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.566527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.566676 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.566914 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.566914 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.567216 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.567368 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.567552 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.567721 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.567721 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.568067 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.568882 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.569091 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.569263 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.569414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.569572 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.569722 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.569873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.570031 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.570191 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.570349 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.570514 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.570664 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.570840 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.571395 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.571569 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.571721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.571889 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.572155 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.572430 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.572635 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.572809 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.572970 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.573122 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.573283 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.573433 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.573597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.573755 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.573914 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.574066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.574217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.574365 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.574529 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.574688 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.574838 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.574996 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.575148 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.575379 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.575643 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.575945 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.576108 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.576260 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.576260 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.576556 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.576745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.576745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.577051 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.577247 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.577397 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.577569 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.577728 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.577887 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.578048 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.578199 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.578350 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.578510 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.578669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.578827 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.579024 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.579181 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.579339 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.579504 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.579665 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.579824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.580058 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.580217 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.580367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.580532 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.580719 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.580886 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.581467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.581635 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.581797 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.581947 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.582103 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.582423 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.582899 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.583061 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.583228 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.583380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.583567 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.583732 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.583875 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.584031 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.584137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.584231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.584322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.584407 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.584496 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.584588 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.584685 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.584771 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.584853 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.584943 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.585027 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.585118 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.585211 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.585295 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.585598 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.585688 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.585760 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.585840 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.586087 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.586177 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.586261 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.586334 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.586411 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.586492 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.586564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.586639 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.586639 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.586773 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.586845 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.587162 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.587260 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.587391 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.587477 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.587560 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.587652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.587750 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.587847 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.587920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.588037 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.588107 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.588196 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.588282 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.588365 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.588447 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.588528 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.588610 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.588702 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.588788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.588859 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.588934 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.589025 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.589109 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.589205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.589291 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.589373 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.589463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.589546 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.589628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.589727 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.589812 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.589902 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.589902 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.590055 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.590147 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.590231 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.590312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.590394 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.590475 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.590556 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.590650 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.590733 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.590822 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.590905 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.590987 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.591072 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.591179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.591477 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.591576 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.591669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.591669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.591821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.591821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.592014 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.592149 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.592303 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.592462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.592578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.592775 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.592879 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.593080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.593191 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.593393 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.593505 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.593700 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.593804 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.594120 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.594231 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.594436 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.594553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.594752 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.594855 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.595067 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.595178 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.595373 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.595485 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.595676 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.595779 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.596011 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.596125 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.596849 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.596954 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.597157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.597251 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.597465 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.597559 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.597772 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.597866 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.598095 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.598196 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.598402 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.598503 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.598723 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.598825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.599039 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.599132 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.599353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.599455 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.599678 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.599773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.600080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.600180 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.600390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.600500 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.600700 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.600801 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.601021 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.601122 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.601328 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.601427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.601689 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.601831 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.601996 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.602251 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.602346 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.602568 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.602672 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.602873 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.602968 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.603226 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.603319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.603568 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.603714 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.603885 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.604183 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.604288 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.604508 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.604612 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.604836 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.604933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.605151 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.605260 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.605475 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.605571 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.605839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.605931 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.606155 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.606257 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.606483 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.606585 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.606806 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.606902 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.607120 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.607258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.607426 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.607535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.607766 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.607869 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.608068 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.608168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.608391 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.608759 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.609033 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.609206 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.609450 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.609535 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.609775 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.609859 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.610091 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.610182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.610418 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.610508 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.610749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.610841 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.611057 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.611155 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.611360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.611442 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.611724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.611820 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.613921 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.614051 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.614132 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.614204 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.614300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.614396 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.614482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.614576 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.614668 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.614761 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.614847 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.614945 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.615041 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.615134 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.615219 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.615309 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.615400 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.615485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.615588 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.615681 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.615773 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.615866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.616013 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.616986 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.617092 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.617175 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.617248 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.617326 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.617398 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.617482 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.617563 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.617563 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.617711 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.617867 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.617953 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.618126 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.618229 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.618431 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.618532 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.618736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.618829 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.619078 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.619173 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.619381 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.619474 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.619705 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.619808 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.620038 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.620179 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.620345 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.620451 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.620657 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.620769 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.620970 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.621080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.621275 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.621377 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.621582 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.621698 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.621893 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.622267 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.622369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.622455 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.622539 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.622632 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.622774 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.622888 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.623097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.623199 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.623402 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.623510 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.623724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.623814 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.624062 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.624225 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.624371 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.624525 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.624666 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.624815 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.624965 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.625106 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.625291 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.625433 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.625575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.625721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.625879 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.626025 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.626182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.626323 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.626490 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.626636 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.626867 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.626991 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.627169 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.627265 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.627479 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.627694 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.627825 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.627926 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.628162 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.628263 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.628477 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.628577 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.628792 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.628899 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.629102 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.629199 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.629418 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.629517 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.629731 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.629836 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.630045 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.630152 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.630360 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.630602 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.630703 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.630940 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.631042 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.631256 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.631357 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.631571 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.631664 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.631884 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.631994 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.632242 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.632349 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.632537 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.632703 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.632849 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.633085 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.633179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.633419 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.633519 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.633740 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.633837 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.634097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.634179 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.634376 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.634469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.634692 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.634785 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.635028 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.635421 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.635536 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.635639 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.635743 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.635838 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.636170 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.636283 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.636386 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.636484 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.636627 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.636737 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.636935 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.637036 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.637241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.637336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.637557 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.637650 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.637872 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.637965 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.638186 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.638286 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.638498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.638591 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.638810 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.638909 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.639122 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.639216 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.639434 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.639538 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.639747 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.639919 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.640083 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.640189 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.640399 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.640500 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.640711 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.640823 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.641026 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.641121 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.641339 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.641447 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.641654 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.641757 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.641967 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.642082 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.642278 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.642387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.642593 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.642699 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.642906 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.643101 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.643242 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.643443 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.643573 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.643775 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.643914 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.644126 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.644256 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.644452 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.644573 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.644770 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.644873 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.645089 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.645183 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.645418 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.645668 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.645768 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.645990 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.646105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.646315 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.646419 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.646629 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.646724 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.646936 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.647083 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.647254 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.647411 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.647554 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.647693 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.647850 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.648042 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.648189 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.648347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.648496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.648639 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.648787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.649075 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.649233 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.649374 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.649518 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.649688 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.649827 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.650001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.650158 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.650301 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.650557 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.650708 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.650851 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.650947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.651083 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.651257 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.651505 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.651655 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.651854 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.652035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.652193 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.652286 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.652503 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.652616 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.652808 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.652916 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.653110 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.653204 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.653420 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.653514 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.653730 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.653838 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.654033 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.654133 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.654339 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.654459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.654640 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.655030 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.655221 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.655373 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.655523 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.655668 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.655819 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.656157 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.656157 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.656431 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.656574 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.656731 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.656861 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.656946 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.657031 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.657115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.657304 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.657397 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.657609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.657710 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.657917 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.658010 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.658217 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.658362 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.658518 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.658618 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.659333 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.659441 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.659652 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.659764 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.659990 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.660116 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.660289 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.660398 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.660603 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.660708 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.660920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.661021 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.661222 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.661316 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.661533 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.661642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.661840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.661935 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.662151 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.662245 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.662456 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.662614 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.662817 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.662973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.663116 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.663280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.663427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.663580 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.663730 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.663878 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.664035 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.664250 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.664361 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.664591 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.664710 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.664919 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.665026 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.665253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.665363 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.665561 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.665654 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.665885 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.665975 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.666195 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.666363 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.666504 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.666802 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.666974 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.667119 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.667277 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.667422 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.667562 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.667730 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.667873 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.668118 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.668229 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.668367 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.668461 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.668680 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.668774 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.668982 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.669084 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.669292 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.669391 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.669603 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.669717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.669913 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.670088 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.670218 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.670319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.670528 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.670623 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.670840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.670932 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.671150 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.671240 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.671458 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.671550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.671769 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.671864 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.672118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.672225 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.672435 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.672602 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.672770 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.672912 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.673063 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.673214 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.673375 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.673527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.673672 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.673820 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.673958 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.674100 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.674238 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.674384 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.675335 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.675503 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.675655 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.675798 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.675968 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.676078 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.676315 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.676507 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.676824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.676931 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.677146 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.677410 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.677513 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.677767 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.677867 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.678089 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.678192 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.678410 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.678505 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.678723 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.678970 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.679065 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.679344 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.679554 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.679674 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.680050 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.680210 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.680389 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.680547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.680669 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.680980 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.681096 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.681290 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.681620 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.681723 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.681907 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.682201 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.682320 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.682523 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.682790 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.682893 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.683187 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.683343 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.683554 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.683706 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.683873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.684087 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.684252 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.684401 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.684564 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.684684 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.684782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.684914 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.685009 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.685260 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.685384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.685569 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.685814 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.686046 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.686263 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.686447 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.686577 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.686686 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.686775 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.686860 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.686945 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.687030 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.687123 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.687327 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.687433 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.687629 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.687723 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.687954 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.688066 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.688257 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.688358 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.688561 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.688653 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.688894 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.689004 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.689233 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.689393 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.689546 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.689640 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.689852 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.689960 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.690191 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.690297 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.690505 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.690608 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.690811 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.690912 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.691122 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.691215 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.691430 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.691522 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.691736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.691838 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.692070 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.692168 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.692379 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.692475 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.692696 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.692802 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.693003 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.693123 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.693309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.693404 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.693617 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.693711 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.693926 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.694111 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.694267 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.694418 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.694571 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.694670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.694879 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.694974 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.695198 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.695330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.695523 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.695648 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.695835 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.695961 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.696189 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.696299 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.696506 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.696604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.696819 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.696917 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.697148 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.697243 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.697462 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.697576 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.697772 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.697866 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.698081 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.698176 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.698392 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.698488 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.698701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.698803 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.699014 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.699108 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.699322 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.699414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.699632 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.699739 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.700038 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.700137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.700279 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.700420 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.700595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.700773 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.700919 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.701015 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.701233 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.701328 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.701552 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.701662 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.701876 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.701979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.702224 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.702326 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.702537 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.702640 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.702881 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.703010 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.703191 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.703300 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.703502 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.703595 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.703815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.703917 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.704142 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.704239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.704387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:32:08.704482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.704765 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.705080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.705473 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.705733 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.706052 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.706378 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.706702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.707013 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.707339 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.707669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.708040 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.708358 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.708703 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.709030 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.709344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.709657 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.709960 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:32:08.710203 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:32:08.766032 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO dbcounter [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] Registered counter for database nova_api Aug 29 20:32:08.772813 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO dbcounter [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] Registered counter for database nova_api Aug 29 20:32:08.787474 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_db.sqlalchemy.engines [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127027) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:32:08.793534 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_db.sqlalchemy.engines [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:32:08.794708 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writer thread running {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:32:08.800043 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writer thread running {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:32:08.853249 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.context [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26164e1e-1563-420b-9abf-15fd66346c73(cell1) {{(pid=127027) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:32:08.855797 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.context [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26164e1e-1563-420b-9abf-15fd66346c73(cell1) {{(pid=127028) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 20:32:08.857952 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:08.858473 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:08.859759 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:08.860254 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:08.860359 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:08.861029 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:08.861551 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:08.861813 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:08.862561 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:32:08.863007 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:32:08.863661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:08.865057 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:32:08.865675 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO dbcounter [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] Registered counter for database nova_cell0 Aug 29 20:32:08.867080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO dbcounter [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] Registered counter for database nova_cell0 Aug 29 20:32:08.869641 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO dbcounter [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] Registered counter for database nova_cell1 Aug 29 20:32:08.871097 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO dbcounter [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] Registered counter for database nova_cell1 Aug 29 20:32:08.877006 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_db.sqlalchemy.engines [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127027) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:32:08.880187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_db.sqlalchemy.engines [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:32:08.880991 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_db.sqlalchemy.engines [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:32:08.881362 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_db.sqlalchemy.engines [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127027) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:32:08.885815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writer thread running {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:32:08.887502 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writer thread running {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:32:08.889985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writer thread running {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:32:08.891749 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writer thread running {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:32:09.038968 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO dbcounter [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] Registered counter for database nova_cell0 Aug 29 20:32:09.039187 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO dbcounter [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] Registered counter for database nova_cell0 Aug 29 20:32:09.048125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_db.sqlalchemy.engines [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127027) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:32:09.052073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_db.sqlalchemy.engines [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:32:09.053243 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writer thread running {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:32:09.056772 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writer thread running {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:32:09.376928 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: WARNING keystonemiddleware.auth_token [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:32:09.377680 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: WARNING keystonemiddleware.auth_token [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:32:09.384318 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: WARNING keystonemiddleware.auth_token [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:32:09.384968 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: WARNING keystonemiddleware.auth_token [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:32:09.733535 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: WARNING keystonemiddleware.auth_token [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:32:09.736265 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: WARNING keystonemiddleware.auth_token [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 20:32:09.740277 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: WARNING keystonemiddleware.auth_token [None req-0412cd80-aac6-4cf2-9ce8-12d2640211b9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:32:09.742254 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: WARNING keystonemiddleware.auth_token [None req-138ebedd-6d19-48b9-8b9e-9c8b57ee57c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 20:32:09.745588 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5648a5fea9c0 pid: 127027 (default app) Aug 29 20:32:09.747499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5648a5fea9c0 pid: 127028 (default app) Aug 29 20:32:46.302364 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=3 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:46.303604 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=3 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:46.304662 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=3 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:46.306215 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=3 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:46.688412 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:46.689615 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:46.690540 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:46.691446 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:47.907489 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-10f5d1c4-0608-4d01-a1b1-e944880d7441 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Action: 'create', calling method: .version_select at 0x7f486431bee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1971563368"}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:48.256257 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71d89b6e-ee24-4b94-993a-c9bfe4d11623 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Action: 'create', calling method: .version_select at 0x7f486431cee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-409963541", "metadata": {"Type": "work"}}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71d89b6e-ee24-4b94-993a-c9bfe4d11623 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Request method failure captured: Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 121 Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJu0oMqGPWrlzVSWJIKfmc4pN0-DHPNIbbwHmF9Ynb3IAfmRnlwyhZ_Zp_pKg4SVHAcnUtHR9DBfKguauFrybUX7TdpK1mjDeARxhQi8muWlqXIYRVvwZkFxaEWEsNwzQfXk_a2tCBDntOb6xL-JzJoCNppdew-nW_xk1yLuKMQMG4 Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: e97ceb2f66cf4762b62ffbedcf11b9a1 Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:32:48.264553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:32:48.265955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e97ceb2f66cf4762b62ffbedcf11b9a1"}]}] Aug 29 20:32:48.265955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:48.265955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: e97ceb2f66cf4762b62ffbedcf11b9a1 Aug 29 20:32:48.265955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:48.265955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-VolumesNegativeTest-1097061016-project Aug 29 20:32:48.265955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:32:48.265955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:32:48.265955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: abefeff1898c4f27b14f11fb8c6ab740 Aug 29 20:32:48.265955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-VolumesNegativeTest-1097061016-project Aug 29 20:32:48.265955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Aug 29 20:32:48.265955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-409963541", "metadata": {"Type": "work"}}} Aug 29 20:32:48.265955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: Aug 29 20:32:48.265955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-409963541', 'metadata': {'Type': 'work'}}}} Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:32:48.266787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 20:32:48.268168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 20:32:48.269259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 20:32:48.269259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:48.270887 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-71d89b6e-ee24-4b94-993a-c9bfe4d11623 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:32:48.272115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-71d89b6e-ee24-4b94-993a-c9bfe4d11623 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.594155 Aug 29 20:32:48.272872 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1156 bytes} [Mon Aug 29 20:32:46 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1596 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 20:32:48.278300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e2c9fc89-c528-48e0-818f-5bfe1570f6d1 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] Calling method '.version_select at 0x7f48642d59d0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:49.366370 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e2c9fc89-c528-48e0-818f-5bfe1570f6d1 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/4ca66a20-99fd-4d73-af0f-da2283450820" status: 200 len: 351 microversion: 2.1 time: 1.091418 Aug 29 20:32:49.367540 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 2/2] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:32:48 2022] GET /compute/v2.1/os-volumes/4ca66a20-99fd-4d73-af0f-da2283450820 => generated 351 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:49.380532 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00d2aa3f-088f-4167-aa26-1928fa12824e tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Action: 'create', calling method: .version_select at 0x7f486415f280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1692745255", "metadata": {"Type": "work"}}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00d2aa3f-088f-4167-aa26-1928fa12824e tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Request method failure captured: Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 120 Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJu0oMqGPWrlzVSWJIKfmc4pN0-DHPNIbbwHmF9Ynb3IAfmRnlwyhZ_Zp_pKg4SVHAcnUtHR9DBfKguauFrybUX7TdpK1mjDeARxhQi8muWlqXIYRVvwZkFxaEWEsNwzQfXk_a2tCBDntOb6xL-JzJoCNppdew-nW_xk1yLuKMQMG4 Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: e97ceb2f66cf4762b62ffbedcf11b9a1 Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:32:49.390438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:32:49.391839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e97ceb2f66cf4762b62ffbedcf11b9a1"}]}] Aug 29 20:32:49.391839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:49.391839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: e97ceb2f66cf4762b62ffbedcf11b9a1 Aug 29 20:32:49.391839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:49.391839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-VolumesNegativeTest-1097061016-project Aug 29 20:32:49.391839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:32:49.391839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:32:49.391839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: abefeff1898c4f27b14f11fb8c6ab740 Aug 29 20:32:49.391839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-VolumesNegativeTest-1097061016-project Aug 29 20:32:49.391839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Aug 29 20:32:49.391839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1692745255", "metadata": {"Type": "work"}}} Aug 29 20:32:49.391839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: Aug 29 20:32:49.391839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1692745255', 'metadata': {'Type': 'work'}}}} Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi '0' Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:32:49.392716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 20:32:49.393963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 20:32:49.396097 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 20:32:49.396097 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.396431 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00d2aa3f-088f-4167-aa26-1928fa12824e tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:32:49.404364 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-00d2aa3f-088f-4167-aa26-1928fa12824e tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.031476 Aug 29 20:32:49.405014 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 3/3] 10.222.0.18 () {60 vars in 1156 bytes} [Mon Aug 29 20:32:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:32:49.418879 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8a72f74a-a8de-4d6e-a88f-5ceb2079c9dd tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Action: 'create', calling method: .version_select at 0x7f486416d670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-978943946", "metadata": {"Type": "work"}}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8a72f74a-a8de-4d6e-a88f-5ceb2079c9dd tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Request method failure captured: Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 118 Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJu0oMqGPWrlzVSWJIKfmc4pN0-DHPNIbbwHmF9Ynb3IAfmRnlwyhZ_Zp_pKg4SVHAcnUtHR9DBfKguauFrybUX7TdpK1mjDeARxhQi8muWlqXIYRVvwZkFxaEWEsNwzQfXk_a2tCBDntOb6xL-JzJoCNppdew-nW_xk1yLuKMQMG4 Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: e97ceb2f66cf4762b62ffbedcf11b9a1 Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:32:49.426059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:32:49.427578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e97ceb2f66cf4762b62ffbedcf11b9a1"}]}] Aug 29 20:32:49.427578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:49.427578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: e97ceb2f66cf4762b62ffbedcf11b9a1 Aug 29 20:32:49.427578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:49.427578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-VolumesNegativeTest-1097061016-project Aug 29 20:32:49.427578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:32:49.427578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:32:49.427578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: abefeff1898c4f27b14f11fb8c6ab740 Aug 29 20:32:49.427578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-VolumesNegativeTest-1097061016-project Aug 29 20:32:49.427578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Aug 29 20:32:49.427578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-978943946", "metadata": {"Type": "work"}}} Aug 29 20:32:49.427578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: Aug 29 20:32:49.427578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-978943946', 'metadata': {'Type': 'work'}}}} Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise error Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi '' Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:32:49.428387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 20:32:49.429642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 20:32:49.430698 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 20:32:49.430698 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:49.433662 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8a72f74a-a8de-4d6e-a88f-5ceb2079c9dd tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:32:49.435700 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8a72f74a-a8de-4d6e-a88f-5ceb2079c9dd tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021065 Aug 29 20:32:49.444134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 4/4] 10.222.0.18 () {60 vars in 1156 bytes} [Mon Aug 29 20:32:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:32:49.452254 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a49fd0f8-dea7-4057-981f-476af981de55 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Calling method '.version_select at 0x7f486415f430>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:50.096575 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-a49fd0f8-dea7-4057-981f-476af981de55 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] HTTP exception thrown: Volume tempest-invalid-1932582886 could not be found. Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a49fd0f8-dea7-4057-981f-476af981de55 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Request method failure captured: Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1932582886 HTTP/1.1 Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJu0oMqGPWrlzVSWJIKfmc4pN0-DHPNIbbwHmF9Ynb3IAfmRnlwyhZ_Zp_pKg4SVHAcnUtHR9DBfKguauFrybUX7TdpK1mjDeARxhQi8muWlqXIYRVvwZkFxaEWEsNwzQfXk_a2tCBDntOb6xL-JzJoCNppdew-nW_xk1yLuKMQMG4 Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: e97ceb2f66cf4762b62ffbedcf11b9a1 Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:32:50.100735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:32:50.102056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e97ceb2f66cf4762b62ffbedcf11b9a1"}]}] Aug 29 20:32:50.102056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:50.102056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: e97ceb2f66cf4762b62ffbedcf11b9a1 Aug 29 20:32:50.102056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:50.102056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-VolumesNegativeTest-1097061016-project Aug 29 20:32:50.102056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:32:50.102056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:32:50.102056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: abefeff1898c4f27b14f11fb8c6ab740 Aug 29 20:32:50.102056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-VolumesNegativeTest-1097061016-project Aug 29 20:32:50.102056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: Aug 29 20:32:50.102056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Volume tempest-invalid-1932582886 could not be found. Aug 29 20:32:50.102056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': 'tempest-invalid-1932582886'} Aug 29 20:32:50.102056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1932582886 could not be found. (HTTP 404) (Request-ID: req-dc5e6e8e-4fad-413e-984c-e195b773f151) Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:50.102787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:32:50.104022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1932582886 could not be found. Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:32:50.105118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1932582886 could not be found. Aug 29 20:32:50.106223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.106223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:50.106223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.106223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:50.106223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:50.106223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:50.106223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:32:50.106223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:32:50.106223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1932582886 could not be found. Aug 29 20:32:50.106223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.106223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a49fd0f8-dea7-4057-981f-476af981de55 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Returning 404 to user: Volume tempest-invalid-1932582886 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:32:50.106223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a49fd0f8-dea7-4057-981f-476af981de55 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1932582886" status: 404 len: 99 microversion: 2.1 time: 0.655415 Aug 29 20:32:50.109409 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 5/5] 10.222.0.18 () {58 vars in 1218 bytes} [Mon Aug 29 20:32:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1932582886 => generated 99 bytes in 664 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 20:32:50.126740 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a23211c6-4986-453c-8677-c58f0624a3b1 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012335 Aug 29 20:32:50.135195 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 6/6] 10.222.0.18 () {58 vars in 1140 bytes} [Mon Aug 29 20:32:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 20:32:50.149107 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7d555b4d-e7f4-49da-ba86-7395ce19aa82 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011529 Aug 29 20:32:50.156101 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 7/7] 10.222.0.18 () {58 vars in 1137 bytes} [Mon Aug 29 20:32:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 20:32:50.170278 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cc41ebaa-f9d6-4605-b911-daa3ca78dc69 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Calling method '.version_select at 0x7f486415fee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:50.348137 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-10f5d1c4-0608-4d01-a1b1-e944880d7441 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.065610 Aug 29 20:32:50.348783 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 1/8] 10.222.0.18 () {60 vars in 1155 bytes} [Mon Aug 29 20:32:46 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4068 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 20:32:50.363645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8dc30689-e60b-4fa8-808e-36417be61fe2 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f486419cd30>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-cc41ebaa-f9d6-4605-b911-daa3ca78dc69 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] HTTP exception thrown: Volume e5f39caf-a942-4d76-b1fe-0d8ad2942d6b could not be found. Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cc41ebaa-f9d6-4605-b911-daa3ca78dc69 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Request method failure captured: Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: DELETE /compute/v2.1/os-volumes/e5f39caf-a942-4d76-b1fe-0d8ad2942d6b HTTP/1.1 Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJu0oMqGPWrlzVSWJIKfmc4pN0-DHPNIbbwHmF9Ynb3IAfmRnlwyhZ_Zp_pKg4SVHAcnUtHR9DBfKguauFrybUX7TdpK1mjDeARxhQi8muWlqXIYRVvwZkFxaEWEsNwzQfXk_a2tCBDntOb6xL-JzJoCNppdew-nW_xk1yLuKMQMG4 Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: e97ceb2f66cf4762b62ffbedcf11b9a1 Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:32:50.392280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:32:50.394236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e97ceb2f66cf4762b62ffbedcf11b9a1"}]}] Aug 29 20:32:50.394236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:50.394236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: e97ceb2f66cf4762b62ffbedcf11b9a1 Aug 29 20:32:50.394236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:50.394236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-VolumesNegativeTest-1097061016-project Aug 29 20:32:50.394236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:32:50.394236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:32:50.394236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: abefeff1898c4f27b14f11fb8c6ab740 Aug 29 20:32:50.394236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-VolumesNegativeTest-1097061016-project Aug 29 20:32:50.394236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: Aug 29 20:32:50.394236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Volume e5f39caf-a942-4d76-b1fe-0d8ad2942d6b could not be found. Aug 29 20:32:50.394236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': 'e5f39caf-a942-4d76-b1fe-0d8ad2942d6b'} Aug 29 20:32:50.394236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e5f39caf-a942-4d76-b1fe-0d8ad2942d6b could not be found. (HTTP 404) (Request-ID: req-eb0d65fc-f8fe-48cb-8fad-0becbf481a7d) Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:50.395073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:32:50.400034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e5f39caf-a942-4d76-b1fe-0d8ad2942d6b could not be found. Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 20:32:50.402628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:32:50.405947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e5f39caf-a942-4d76-b1fe-0d8ad2942d6b could not be found. Aug 29 20:32:50.405947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.405947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:50.405947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.405947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:50.405947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:50.405947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:50.405947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:32:50.405947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:32:50.405947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e5f39caf-a942-4d76-b1fe-0d8ad2942d6b could not be found. Aug 29 20:32:50.405947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.405947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cc41ebaa-f9d6-4605-b911-daa3ca78dc69 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Returning 404 to user: Volume e5f39caf-a942-4d76-b1fe-0d8ad2942d6b could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:32:50.405947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cc41ebaa-f9d6-4605-b911-daa3ca78dc69 tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/e5f39caf-a942-4d76-b1fe-0d8ad2942d6b" status: 404 len: 109 microversion: 2.1 time: 0.229162 Aug 29 20:32:50.405947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 8/9] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 29 20:32:50 2022] DELETE /compute/v2.1/os-volumes/e5f39caf-a942-4d76-b1fe-0d8ad2942d6b => generated 109 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:32:50.410516 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6c3aaa0e-778f-4c6a-ad67-304f3445ca0f tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Calling method '.version_select at 0x7f486416d280>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:50.507502 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8dc30689-e60b-4fa8-808e-36417be61fe2 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74" status: 200 len: 346 microversion: 2.1 time: 0.148185 Aug 29 20:32:50.508383 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 2/10] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:32:50 2022] GET /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74 => generated 346 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:32:50.522518 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6a45fdff-7846-4675-9d9a-c086bbb54827 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Action: 'create', calling method: .version_select at 0x7f48641b53a0>, body: {"snapshot": {"volume_id": "23d25988-eeb5-4f6e-b1c4-a327ed731d74", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1146014052"}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:50.546352 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-6c3aaa0e-778f-4c6a-ad67-304f3445ca0f tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] HTTP exception thrown: Volume 6c216788-725e-4def-a6e6-5c1e814deb40 could not be found. Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6c3aaa0e-778f-4c6a-ad67-304f3445ca0f tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Request method failure captured: Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/os-volumes/6c216788-725e-4def-a6e6-5c1e814deb40 HTTP/1.1 Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJu0oMqGPWrlzVSWJIKfmc4pN0-DHPNIbbwHmF9Ynb3IAfmRnlwyhZ_Zp_pKg4SVHAcnUtHR9DBfKguauFrybUX7TdpK1mjDeARxhQi8muWlqXIYRVvwZkFxaEWEsNwzQfXk_a2tCBDntOb6xL-JzJoCNppdew-nW_xk1yLuKMQMG4 Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: e97ceb2f66cf4762b62ffbedcf11b9a1 Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:32:50.548585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:32:50.549920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e97ceb2f66cf4762b62ffbedcf11b9a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e97ceb2f66cf4762b62ffbedcf11b9a1"}]}] Aug 29 20:32:50.549920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:50.549920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: e97ceb2f66cf4762b62ffbedcf11b9a1 Aug 29 20:32:50.549920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesNegativeTest-1097061016 Aug 29 20:32:50.549920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-VolumesNegativeTest-1097061016-project Aug 29 20:32:50.549920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:32:50.549920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:32:50.549920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: abefeff1898c4f27b14f11fb8c6ab740 Aug 29 20:32:50.549920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-VolumesNegativeTest-1097061016-project Aug 29 20:32:50.549920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: Aug 29 20:32:50.549920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Volume 6c216788-725e-4def-a6e6-5c1e814deb40 could not be found. Aug 29 20:32:50.549920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '6c216788-725e-4def-a6e6-5c1e814deb40'} Aug 29 20:32:50.549920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c216788-725e-4def-a6e6-5c1e814deb40 could not be found. (HTTP 404) (Request-ID: req-7857e7c0-9666-420e-a2c0-f3f9f288cce7) Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:50.550717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:32:50.551816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c216788-725e-4def-a6e6-5c1e814deb40 could not be found. Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:32:50.554354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:32:50.558309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c216788-725e-4def-a6e6-5c1e814deb40 could not be found. Aug 29 20:32:50.558309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.558309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:50.558309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.558309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:50.558309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:50.558309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:50.558309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:32:50.558309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:32:50.558309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c216788-725e-4def-a6e6-5c1e814deb40 could not be found. Aug 29 20:32:50.558309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:50.558309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6c3aaa0e-778f-4c6a-ad67-304f3445ca0f tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] Returning 404 to user: Volume 6c216788-725e-4def-a6e6-5c1e814deb40 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:32:50.558309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6c3aaa0e-778f-4c6a-ad67-304f3445ca0f tempest-VolumesNegativeTest-1097061016 tempest-VolumesNegativeTest-1097061016-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6c216788-725e-4def-a6e6-5c1e814deb40" status: 404 len: 109 microversion: 2.1 time: 0.155946 Aug 29 20:32:50.558309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 9/11] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:32:50 2022] GET /compute/v2.1/os-volumes/6c216788-725e-4def-a6e6-5c1e814deb40 => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:32:51.214950 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6a45fdff-7846-4675-9d9a-c086bbb54827 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.696724 Aug 29 20:32:51.216271 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 3/12] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Aug 29 20:32:50 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:32:51.249497 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-881ffa78-79ef-4504-8852-349a06e8765c tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f486415f1f0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:51.533646 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-881ffa78-79ef-4504-8852-349a06e8765c tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847" status: 200 len: 287 microversion: 2.1 time: 0.301034 Aug 29 20:32:51.534878 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 10/13] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 29 20:32:51 2022] GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847 => generated 287 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:51.550263 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-c23c4168-f540-41ca-b810-15e255af0d0d tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f486413b550>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:51.645362 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d72a998-1af1-4d6e-b16f-d7cf82b1b4f4 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] Calling method '.version_select at 0x7f486416d700>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:51.698338 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c23c4168-f540-41ca-b810-15e255af0d0d tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.152052 Aug 29 20:32:51.699441 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 4/14] 10.222.0.18 () {58 vars in 1140 bytes} [Mon Aug 29 20:32:51 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:51.711594 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2c386efc-ed30-4611-a28a-07dd1f19877f tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f48641b5280>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:51.794587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9d72a998-1af1-4d6e-b16f-d7cf82b1b4f4 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b6a441b2-cb54-46d1-ab5d-6e40d7d21386" status: 200 len: 351 microversion: 2.1 time: 0.152982 Aug 29 20:32:51.795295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 11/15] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:32:51 2022] GET /compute/v2.1/os-volumes/b6a441b2-cb54-46d1-ab5d-6e40d7d21386 => generated 351 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:32:51.849035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2c386efc-ed30-4611-a28a-07dd1f19877f tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847" status: 200 len: 287 microversion: 2.1 time: 0.141825 Aug 29 20:32:51.849624 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 5/16] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 29 20:32:51 2022] GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847 => generated 287 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:32:52.863578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dba46913-8abc-41a4-8b6b-e89554e6bafe tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f48640ca310>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:52.922686 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dba46913-8abc-41a4-8b6b-e89554e6bafe tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847" status: 200 len: 287 microversion: 2.1 time: 0.062872 Aug 29 20:32:52.923666 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 12/17] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 29 20:32:52 2022] GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:53.934911 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-bc4c1c0e-918c-44a9-8335-faea5a944c72 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f486419cb80>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:54.033096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-bc4c1c0e-918c-44a9-8335-faea5a944c72 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847" status: 200 len: 287 microversion: 2.1 time: 0.102137 Aug 29 20:32:54.033870 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 6/18] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 29 20:32:53 2022] GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847 => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:55.047293 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ff7dc8a8-8ec5-46f3-a58d-08e226e36fcc tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f486415f790>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:55.133322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ff7dc8a8-8ec5-46f3-a58d-08e226e36fcc tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847" status: 200 len: 288 microversion: 2.1 time: 0.090390 Aug 29 20:32:55.134157 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 13/19] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 29 20:32:55 2022] GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847 => generated 288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:55.146566 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-645d1d78-52c0-4be6-bd02-4d467b65b53b tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f486413b160>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:55.255541 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-645d1d78-52c0-4be6-bd02-4d467b65b53b tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847" status: 202 len: 0 microversion: 2.1 time: 0.113362 Aug 29 20:32:55.256415 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 7/20] 10.222.0.18 () {58 vars in 1254 bytes} [Mon Aug 29 20:32:55 2022] DELETE /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:32:55.267251 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f0c248e4-2144-4c85-b8e9-f3293e3c8daa tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f486415f3a0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:55.339909 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f0c248e4-2144-4c85-b8e9-f3293e3c8daa tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847" status: 200 len: 287 microversion: 2.1 time: 0.077938 Aug 29 20:32:55.340939 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 14/21] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 29 20:32:55 2022] GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:56.354227 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f7eecabf-9270-4d91-96d7-254f6c24ea60 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f486419cc10>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:56.398582 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-f7eecabf-9270-4d91-96d7-254f6c24ea60 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847" status: 200 len: 287 microversion: 2.1 time: 0.048292 Aug 29 20:32:56.399187 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 8/22] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 29 20:32:56 2022] GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:57.413103 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e4d53eae-2c7d-4a87-8b4f-e956c21ed18d tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f486411eaf0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:57.510506 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e4d53eae-2c7d-4a87-8b4f-e956c21ed18d tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847" status: 200 len: 287 microversion: 2.1 time: 0.103160 Aug 29 20:32:57.511339 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 15/23] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 29 20:32:57 2022] GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847 => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:58.347867 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2519d126-9465-4b2c-8ef0-922d800b627a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Action: 'create', calling method: .version_select at 0x7f48641b5280>, body: {"keypair": {"name": "tempest-keypair-296670177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwluBp90/3dxTg4AKxZXPXiEzIId/4hruMBYQYJO0nd8+xWOWmCcYvoO6y8lpLLnqumG9x0ZGNaDa3KniPn+W7nVr6MkDo3mlVbVMJC9CCeTm1Uqjn+JepqgxnU5q6eMA=="}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:32:58.493064 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-2519d126-9465-4b2c-8ef0-922d800b627a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Getting quotas for project 544c78c5c2c44219a7f236b24a107da4. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:32:58.518843 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-2519d126-9465-4b2c-8ef0-922d800b627a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Getting quotas for user adc5854ed52042369a9b153af7da4cfb and project 544c78c5c2c44219a7f236b24a107da4. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:32:58.526306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-14319584-ca8f-4aa3-b56d-bef5a20cb312 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f48640ca280>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:58.633947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-14319584-ca8f-4aa3-b56d-bef5a20cb312 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847" status: 200 len: 287 microversion: 2.1 time: 0.112885 Aug 29 20:32:58.635565 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 16/24] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 29 20:32:58 2022] GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847 => generated 287 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:58.727684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2519d126-9465-4b2c-8ef0-922d800b627a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.740018 Aug 29 20:32:58.732232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 9/25] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 29 20:32:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:59.278947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1b828497-10ab-44db-805e-2452e2618c65 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] Calling method '.version_select at 0x7f486411ed30>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:59.472323 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1b828497-10ab-44db-805e-2452e2618c65 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1a1f4746-1584-4b6c-83e1-cdf6653234fe" status: 200 len: 351 microversion: 2.1 time: 0.207373 Aug 29 20:32:59.476223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 17/26] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:32:59 2022] GET /compute/v2.1/os-volumes/1a1f4746-1584-4b6c-83e1-cdf6653234fe => generated 351 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:32:59.491385 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e269567d-eb92-455c-b1fa-d09b817d1ae1 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] Calling method '.version_select at 0x7f4864118700>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:59.647688 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e64e4c9-f1d6-49e7-beee-aacdac27b944 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f486415f430>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:59.848125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e269567d-eb92-455c-b1fa-d09b817d1ae1 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.362447 Aug 29 20:32:59.849126 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 10/27] 10.222.0.18 () {58 vars in 1134 bytes} [Mon Aug 29 20:32:59 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:32:59.872586 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4aa6ba55-ec42-4aa6-bb07-f4297d7b4390 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] Calling method '.version_select at 0x7f48640cbe50>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:32:59.907837 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-9e64e4c9-f1d6-49e7-beee-aacdac27b944 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] HTTP exception thrown: Snapshot 9439c5b6-c249-4a2f-a421-f783c8f56847 could not be found. Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e64e4c9-f1d6-49e7-beee-aacdac27b944 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Request method failure captured: Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847 HTTP/1.1 Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJu19OFAVFLXdRjIjDrsRzmAkx30MTLVConiBOQoMpXtP_prJwAz_q4yGzvzCxvRtnOsawOGzw_r4qLSeu1PPQqSYfVOD40IrubUrXm_VwLSiMcJjxW8wUHTfmowCCNgMwdOeuxhEuq3Q0FXZiRv44SbDwewsE4Qyxtucs27cDx-tY Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 20abd4fa69204e62b7a49322b31d958f Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-52417279 Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:32:59.910845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:32:59.912188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/20abd4fa69204e62b7a49322b31d958f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20abd4fa69204e62b7a49322b31d958f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20abd4fa69204e62b7a49322b31d958f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_20abd4fa69204e62b7a49322b31d958f"}]}] Aug 29 20:32:59.912188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-VolumesSnapshotsTestJSON-52417279 Aug 29 20:32:59.912188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 20abd4fa69204e62b7a49322b31d958f Aug 29 20:32:59.912188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-52417279 Aug 29 20:32:59.912188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-VolumesSnapshotsTestJSON-52417279-project Aug 29 20:32:59.912188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:32:59.912188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:32:59.912188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: e5e618cf472e4275bec4d6222fa29ebe Aug 29 20:32:59.912188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-VolumesSnapshotsTestJSON-52417279-project Aug 29 20:32:59.912188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: Aug 29 20:32:59.912188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Snapshot 9439c5b6-c249-4a2f-a421-f783c8f56847 could not be found. Aug 29 20:32:59.912188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '9439c5b6-c249-4a2f-a421-f783c8f56847'} Aug 29 20:32:59.912188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9439c5b6-c249-4a2f-a421-f783c8f56847 could not be found. (HTTP 404) (Request-ID: req-9051afdc-cc9c-4b35-9a2b-8fc084ece726) Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:59.912997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:32:59.914281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9439c5b6-c249-4a2f-a421-f783c8f56847 could not be found. Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 20:32:59.915373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:32:59.916344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9439c5b6-c249-4a2f-a421-f783c8f56847 could not be found. Aug 29 20:32:59.916344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:59.916344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:32:59.916344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:59.916344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:32:59.916344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:32:59.916344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:32:59.916344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:32:59.916344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:32:59.916344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9439c5b6-c249-4a2f-a421-f783c8f56847 could not be found. Aug 29 20:32:59.916344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:32:59.919011 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e64e4c9-f1d6-49e7-beee-aacdac27b944 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Returning 404 to user: Snapshot 9439c5b6-c249-4a2f-a421-f783c8f56847 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:32:59.920077 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9e64e4c9-f1d6-49e7-beee-aacdac27b944 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847" status: 404 len: 111 microversion: 2.1 time: 0.276335 Aug 29 20:32:59.920783 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 18/28] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 29 20:32:59 2022] GET /compute/v2.1/os-snapshots/9439c5b6-c249-4a2f-a421-f783c8f56847 => generated 111 bytes in 278 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:32:59.931673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2fdde6b5-5fde-4eca-a073-9746cff47d92 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f486437dee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:00.303416 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4aa6ba55-ec42-4aa6-bb07-f4297d7b4390 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.437664 Aug 29 20:33:00.304293 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 11/29] 10.222.0.18 () {58 vars in 1149 bytes} [Mon Aug 29 20:32:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:00.317161 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2d056e2e-fcea-4353-871e-7344590e6ac5 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] Calling method '.version_select at 0x7f48640cbc10>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:00.555081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2fdde6b5-5fde-4eca-a073-9746cff47d92 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74" status: 202 len: 0 microversion: 2.1 time: 0.628899 Aug 29 20:33:00.556295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 19/30] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 29 20:32:59 2022] DELETE /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74 => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:33:00.565863 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-01dbeac6-0f7e-4508-86c2-f5aa99506acf tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f486411eca0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:00.655831 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2d056e2e-fcea-4353-871e-7344590e6ac5 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.342311 Aug 29 20:33:00.656940 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 12/31] 10.222.0.18 () {58 vars in 1134 bytes} [Mon Aug 29 20:33:00 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:00.669846 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e2957241-48b2-4fb7-8e8b-d3c7c3b54668 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] Calling method '.version_select at 0x7f48641185e0>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:00.734272 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-01dbeac6-0f7e-4508-86c2-f5aa99506acf tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74" status: 200 len: 345 microversion: 2.1 time: 0.172935 Aug 29 20:33:00.735812 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 20/32] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:33:00 2022] GET /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74 => generated 345 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:00.914548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e2957241-48b2-4fb7-8e8b-d3c7c3b54668 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.248946 Aug 29 20:33:00.915430 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 13/33] 10.222.0.18 () {58 vars in 1167 bytes} [Mon Aug 29 20:33:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:00.931358 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0e83a4e0-d037-4e60-8cea-783c9d2cba63 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] Calling method '.version_select at 0x7f486411eb80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:01.128101 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0e83a4e0-d037-4e60-8cea-783c9d2cba63 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.200929 Aug 29 20:33:01.139971 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 21/34] 10.222.0.18 () {58 vars in 1170 bytes} [Mon Aug 29 20:33:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:01.154045 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f0031b21-1d57-4832-9a0b-661b8a4e7f93 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] Calling method '.version_select at 0x7f48640c8e50>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:01.316515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-f0031b21-1d57-4832-9a0b-661b8a4e7f93 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.166391 Aug 29 20:33:01.317403 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 14/35] 10.222.0.18 () {58 vars in 1155 bytes} [Mon Aug 29 20:33:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:01.333075 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f0e8e1f6-b7d6-4c29-b2e9-a35d92a18ae7 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] Calling method '.version_select at 0x7f48640caf70>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:01.571257 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f0e8e1f6-b7d6-4c29-b2e9-a35d92a18ae7 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.243264 Aug 29 20:33:01.572204 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 22/36] 10.222.0.18 () {58 vars in 1188 bytes} [Mon Aug 29 20:33:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:01.590592 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-33cb4ae2-6844-4969-bc0f-0b121c14c9b0 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] Calling method '.version_select at 0x7f48640cb1f0>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:01.749395 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-caa1f205-feb5-4c5f-a32d-226d8582ac2b tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f48640ca940>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:01.792073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-33cb4ae2-6844-4969-bc0f-0b121c14c9b0 tempest-VolumesTestJSON-2031221371 tempest-VolumesTestJSON-2031221371-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.210057 Aug 29 20:33:01.793321 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 15/37] 10.222.0.18 () {58 vars in 1155 bytes} [Mon Aug 29 20:33:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:01.893391 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-caa1f205-feb5-4c5f-a32d-226d8582ac2b tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74" status: 200 len: 345 microversion: 2.1 time: 0.147947 Aug 29 20:33:01.894406 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 23/38] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:33:01 2022] GET /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74 => generated 345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:02.325329 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1783357944", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "networks": [{"uuid": "cf9673f4-1367-4aac-ae26-3824605ed50c"}]}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:02.590217 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.network.neutron [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] validate_networks() for [('cf9673f4-1367-4aac-ae26-3824605ed50c', None, None, None, None, None)] {{(pid=127027) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:33:02.907309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-688fd2c1-b87b-4ab4-ad3b-d86541a3bbed tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f486411eb80>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:03.063613 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-688fd2c1-b87b-4ab4-ad3b-d86541a3bbed tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74" status: 200 len: 345 microversion: 2.1 time: 0.160159 Aug 29 20:33:03.067193 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 24/39] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:33:02 2022] GET /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74 => generated 345 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:03.907216 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1847371183", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:04.068195 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Flavor limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:33:04.071243 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Image limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:33:04.072320 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Flavor pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:33:04.072752 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Image pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:33:04.073408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:33:04.080813 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] validate_networks() for [('9aeb874f-5dc0-4462-96f6-c696d1a7b371', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:33:04.088857 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:04.089590 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:04.090269 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:04.092778 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:04.093535 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:04.094469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:04.143577 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Getting quotas for project 6314d8436170404097713aa7764dff94. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:33:04.156994 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Getting quotas for user 03117ffa81334df8a3467adbfaf96059 and project 6314d8436170404097713aa7764dff94. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:33:04.188955 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Going to run 1 instances... {{(pid=127027) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:33:04.196769 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:33:04.409951 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-f57c5191-d766-4dd5-a9c6-b9f7be8c5f57 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.341565 Aug 29 20:33:04.420698 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 16/40] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:33:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:33:04.448047 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-874736716", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "956a6ad1-026f-40ab-949a-8f68054ef5a2"}], "security_groups": [{"name": "tempest-securitygroup--2072934743"}], "key_name": "tempest-keypair-296670177", "user_data": "}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:04.798327 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.network.neutron [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] validate_networks() for [('956a6ad1-026f-40ab-949a-8f68054ef5a2', None, None, None, None, None)] {{(pid=127027) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:33:05.864433 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Flavor limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:33:05.866992 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Image limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:33:05.867875 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Flavor pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:33:05.868378 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Image pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:33:05.868820 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:33:05.886348 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:05.886868 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:05.887324 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:05.890578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:05.891681 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:05.892169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:05.952490 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Getting quotas for project 544c78c5c2c44219a7f236b24a107da4. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:33:05.965778 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Getting quotas for user adc5854ed52042369a9b153af7da4cfb and project 544c78c5c2c44219a7f236b24a107da4. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:33:06.011865 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:33:06.012482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:33:06.013148 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:33:06.013719 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:33:06.014326 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:33:06.037758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Going to run 1 instances... {{(pid=127027) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:33:06.055488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:33:06.075128 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:06.093320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:06.106445 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:06.108268 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:06.108956 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:06.127282 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:06.238762 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Getting quotas for project 8436d85d931a41cfa6d626c08ad82ef4. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:33:06.253705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Getting quotas for user 8fbc5bd64315421e97931402fb0e3a6a and project 8436d85d931a41cfa6d626c08ad82ef4. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:33:06.270962 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e17c5ea9-2da3-46da-91c2-40c0f6fdcb12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.843365 Aug 29 20:33:06.279084 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 17/41] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:33:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:33:06.313761 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:33:06.314363 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ba0eb3f9-d3de-42f6-9029-240908a7ef53 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f48637feee0>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:06.322225 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:33:06.410062 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-ba0eb3f9-d3de-42f6-9029-240908a7ef53 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] HTTP exception thrown: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ba0eb3f9-d3de-42f6-9029-240908a7ef53 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Request method failure captured: Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74 HTTP/1.1 Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSJu19OFAVFLXdRjIjDrsRzmAkx30MTLVConiBOQoMpXtP_prJwAz_q4yGzvzCxvRtnOsawOGzw_r4qLSeu1PPQqSYfVOD40IrubUrXm_VwLSiMcJjxW8wUHTfmowCCNgMwdOeuxhEuq3Q0FXZiRv44SbDwewsE4Qyxtucs27cDx-tY Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 20abd4fa69204e62b7a49322b31d958f Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-52417279 Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:33:06.414815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:33:06.417105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/20abd4fa69204e62b7a49322b31d958f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20abd4fa69204e62b7a49322b31d958f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20abd4fa69204e62b7a49322b31d958f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_20abd4fa69204e62b7a49322b31d958f"}]}] Aug 29 20:33:06.417105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-VolumesSnapshotsTestJSON-52417279 Aug 29 20:33:06.417105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 20abd4fa69204e62b7a49322b31d958f Aug 29 20:33:06.417105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-52417279 Aug 29 20:33:06.417105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-VolumesSnapshotsTestJSON-52417279-project Aug 29 20:33:06.417105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:33:06.417105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:33:06.417105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: e5e618cf472e4275bec4d6222fa29ebe Aug 29 20:33:06.417105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-VolumesSnapshotsTestJSON-52417279-project Aug 29 20:33:06.417105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: Aug 29 20:33:06.417105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:06.417105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '23d25988-eeb5-4f6e-b1c4-a327ed731d74'} Aug 29 20:33:06.417105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. (HTTP 404) (Request-ID: req-5dd99869-2612-4fe2-90d7-20f911e86618) Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:06.418781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:33:06.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:33:06.425240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:33:06.428459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:06.428459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:33:06.428459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:06.428459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:33:06.428459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:06.428459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:33:06.428459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:33:06.428459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:33:06.428459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:33:06.428459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:06.428459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:33:06.428459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ba0eb3f9-d3de-42f6-9029-240908a7ef53 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Returning 404 to user: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:33:06.428459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ba0eb3f9-d3de-42f6-9029-240908a7ef53 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74" status: 404 len: 109 microversion: 2.1 time: 0.144599 Aug 29 20:33:06.428459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 18/42] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:33:06 2022] GET /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74 => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:33:06.454230 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-94b109a6-ad0a-49d3-87ce-493b7f1ec402 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:06.456123 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-94b109a6-ad0a-49d3-87ce-493b7f1ec402 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:06.573098 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb815050-1901-420e-8c90-b2f9b63213b0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.504680 Aug 29 20:33:06.581461 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 25/43] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:33:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 3514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:33:06.596930 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-95a886f6-3c8b-4693-965e-180b168db583 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:06.613598 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-95a886f6-3c8b-4693-965e-180b168db583 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:06.765571 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-94b109a6-ad0a-49d3-87ce-493b7f1ec402 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:06.814695 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-94b109a6-ad0a-49d3-87ce-493b7f1ec402 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1215 microversion: 2.1 time: 0.388085 Aug 29 20:33:06.815289 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 19/44] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:06 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1215 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:06.836231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-69eec0f6-b8b1-4276-9e3a-b40d9621b60b tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f48637dc280>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:06.909823 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-69eec0f6-b8b1-4276-9e3a-b40d9621b60b tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] HTTP exception thrown: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-69eec0f6-b8b1-4276-9e3a-b40d9621b60b tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Request method failure captured: Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: DELETE /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74 HTTP/1.1 Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSJu19OFAVFLXdRjIjDrsRzmAkx30MTLVConiBOQoMpXtP_prJwAz_q4yGzvzCxvRtnOsawOGzw_r4qLSeu1PPQqSYfVOD40IrubUrXm_VwLSiMcJjxW8wUHTfmowCCNgMwdOeuxhEuq3Q0FXZiRv44SbDwewsE4Qyxtucs27cDx-tY Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 20abd4fa69204e62b7a49322b31d958f Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-52417279 Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:33:06.913167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:33:06.914236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/20abd4fa69204e62b7a49322b31d958f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20abd4fa69204e62b7a49322b31d958f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20abd4fa69204e62b7a49322b31d958f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_20abd4fa69204e62b7a49322b31d958f"}]}] Aug 29 20:33:06.914236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-VolumesSnapshotsTestJSON-52417279 Aug 29 20:33:06.914236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 20abd4fa69204e62b7a49322b31d958f Aug 29 20:33:06.914236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-52417279 Aug 29 20:33:06.914236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-VolumesSnapshotsTestJSON-52417279-project Aug 29 20:33:06.914236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:33:06.914236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:33:06.914236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: e5e618cf472e4275bec4d6222fa29ebe Aug 29 20:33:06.914236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-VolumesSnapshotsTestJSON-52417279-project Aug 29 20:33:06.914236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: Aug 29 20:33:06.914236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:06.914236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '23d25988-eeb5-4f6e-b1c4-a327ed731d74'} Aug 29 20:33:06.914236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. (HTTP 404) (Request-ID: req-f4ed324b-90ed-4588-92b7-01e37fa6f424) Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:06.914971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 20:33:06.916063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 20:33:06.917042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:33:06.918157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:06.918157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:33:06.918157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:06.918157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:33:06.918157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:06.918157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:33:06.918157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:33:06.918157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:33:06.918157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:33:06.918157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:06.918157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:33:06.921108 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-69eec0f6-b8b1-4276-9e3a-b40d9621b60b tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Returning 404 to user: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:33:06.922154 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-69eec0f6-b8b1-4276-9e3a-b40d9621b60b tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74" status: 404 len: 109 microversion: 2.1 time: 0.093486 Aug 29 20:33:06.923745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 20/45] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 29 20:33:06 2022] DELETE /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:33:06.934008 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8a8ffac7-183a-447a-9aaa-dabd7f8430cb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:06.936804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8a8ffac7-183a-447a-9aaa-dabd7f8430cb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:06.991549 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-95a886f6-3c8b-4693-965e-180b168db583 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:07.026522 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-95a886f6-3c8b-4693-965e-180b168db583 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1236 microversion: 2.1 time: 0.443404 Aug 29 20:33:07.036101 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 26/46] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:06 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1236 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:07.045029 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8bcc713c-d333-412c-b555-14292a99e415 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Calling method '.version_select at 0x7f48637d8d30>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:07.117396 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8a8ffac7-183a-447a-9aaa-dabd7f8430cb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:07.130274 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8a8ffac7-183a-447a-9aaa-dabd7f8430cb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1222 microversion: 2.1 time: 0.205013 Aug 29 20:33:07.133679 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 21/47] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:06 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1222 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:07.183560 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-8bcc713c-d333-412c-b555-14292a99e415 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] HTTP exception thrown: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8bcc713c-d333-412c-b555-14292a99e415 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Request method failure captured: Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74 HTTP/1.1 Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJu19OFAVFLXdRjIjDrsRzmAkx30MTLVConiBOQoMpXtP_prJwAz_q4yGzvzCxvRtnOsawOGzw_r4qLSeu1PPQqSYfVOD40IrubUrXm_VwLSiMcJjxW8wUHTfmowCCNgMwdOeuxhEuq3Q0FXZiRv44SbDwewsE4Qyxtucs27cDx-tY Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 20abd4fa69204e62b7a49322b31d958f Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-52417279 Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:33:07.185564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:33:07.186670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/20abd4fa69204e62b7a49322b31d958f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20abd4fa69204e62b7a49322b31d958f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20abd4fa69204e62b7a49322b31d958f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_20abd4fa69204e62b7a49322b31d958f"}]}] Aug 29 20:33:07.186670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-VolumesSnapshotsTestJSON-52417279 Aug 29 20:33:07.186670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 20abd4fa69204e62b7a49322b31d958f Aug 29 20:33:07.186670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-52417279 Aug 29 20:33:07.186670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-VolumesSnapshotsTestJSON-52417279-project Aug 29 20:33:07.186670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:33:07.186670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:33:07.186670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: e5e618cf472e4275bec4d6222fa29ebe Aug 29 20:33:07.186670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-VolumesSnapshotsTestJSON-52417279-project Aug 29 20:33:07.186670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: Aug 29 20:33:07.186670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:07.186670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '23d25988-eeb5-4f6e-b1c4-a327ed731d74'} Aug 29 20:33:07.186670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. (HTTP 404) (Request-ID: req-1dc14943-ff75-49b3-aa5c-26214efe95b9) Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:07.187316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:33:07.188908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:33:07.189825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:33:07.190749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:07.190749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:33:07.190749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:33:07.190749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:33:07.190749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:33:07.190749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:33:07.190749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:33:07.190749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:33:07.190749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:33:07.190749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. Aug 29 20:33:07.190749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:33:07.190749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8bcc713c-d333-412c-b555-14292a99e415 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] Returning 404 to user: Volume 23d25988-eeb5-4f6e-b1c4-a327ed731d74 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:33:07.190749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8bcc713c-d333-412c-b555-14292a99e415 tempest-VolumesSnapshotsTestJSON-52417279 tempest-VolumesSnapshotsTestJSON-52417279-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74" status: 404 len: 109 microversion: 2.1 time: 0.155991 Aug 29 20:33:07.190749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 27/48] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:33:07 2022] GET /compute/v2.1/os-volumes/23d25988-eeb5-4f6e-b1c4-a327ed731d74 => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:33:07.413153 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1717946169", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:07.517589 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.network.neutron [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] validate_networks() for [('9aeb874f-5dc0-4462-96f6-c696d1a7b371', None, None, None, None, None)] {{(pid=127027) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:33:07.840727 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-12674ccd-7efc-4522-9e22-f339ddeaa568 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:07.841602 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-12674ccd-7efc-4522-9e22-f339ddeaa568 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:07.855404 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12674ccd-7efc-4522-9e22-f339ddeaa568 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:07.856634 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12674ccd-7efc-4522-9e22-f339ddeaa568 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:07.858462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12674ccd-7efc-4522-9e22-f339ddeaa568 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:07.860357 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12674ccd-7efc-4522-9e22-f339ddeaa568 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:07.860948 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12674ccd-7efc-4522-9e22-f339ddeaa568 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:07.862251 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-12674ccd-7efc-4522-9e22-f339ddeaa568 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:08.126951 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-12674ccd-7efc-4522-9e22-f339ddeaa568 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:08.144885 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-12674ccd-7efc-4522-9e22-f339ddeaa568 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1219 microversion: 2.1 time: 0.308292 Aug 29 20:33:08.146094 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 28/49] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:07 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1219 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:08.151486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9aa9c5e4-ef91-4b07-8761-633d9b04eeda tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:08.152505 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9aa9c5e4-ef91-4b07-8761-633d9b04eeda tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:08.166440 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9aa9c5e4-ef91-4b07-8761-633d9b04eeda tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:08.167165 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9aa9c5e4-ef91-4b07-8761-633d9b04eeda tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:08.169261 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9aa9c5e4-ef91-4b07-8761-633d9b04eeda tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:08.173589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9aa9c5e4-ef91-4b07-8761-633d9b04eeda tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:08.174407 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9aa9c5e4-ef91-4b07-8761-633d9b04eeda tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:08.175596 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9aa9c5e4-ef91-4b07-8761-633d9b04eeda tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:08.316591 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-9aa9c5e4-ef91-4b07-8761-633d9b04eeda tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:08.327588 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9aa9c5e4-ef91-4b07-8761-633d9b04eeda tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1240 microversion: 2.1 time: 0.180138 Aug 29 20:33:08.330294 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 29/50] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:08 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1240 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:08.552726 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Flavor limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:33:08.553316 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Image limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:33:08.553913 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Flavor pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:33:08.554504 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Image pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:33:08.555011 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:33:08.568535 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:08.569045 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:08.572752 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:08.574009 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:08.574759 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:08.575368 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:08.615065 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Getting quotas for project 8436d85d931a41cfa6d626c08ad82ef4. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:33:08.621518 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Getting quotas for user 8fbc5bd64315421e97931402fb0e3a6a and project 8436d85d931a41cfa6d626c08ad82ef4. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:33:08.647988 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Going to run 1 instances... {{(pid=127027) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:33:08.651192 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:33:08.761060 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-032c4ce8-51ac-415f-8699-0a2d64c085f0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.351835 Aug 29 20:33:08.762839 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 22/51] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:33:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:33:08.776714 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-538573ad-cf95-483d-b2de-340c54ffc90d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:08.785680 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-538573ad-cf95-483d-b2de-340c54ffc90d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:08.872498 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-538573ad-cf95-483d-b2de-340c54ffc90d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:08.893439 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-538573ad-cf95-483d-b2de-340c54ffc90d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1222 microversion: 2.1 time: 0.121809 Aug 29 20:33:08.894039 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 30/52] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:08 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:09.174763 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-184d7342-a032-4a44-a53e-bc308ff08bc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:09.174763 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-184d7342-a032-4a44-a53e-bc308ff08bc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:09.187343 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-184d7342-a032-4a44-a53e-bc308ff08bc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:09.188123 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-184d7342-a032-4a44-a53e-bc308ff08bc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:09.189321 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-184d7342-a032-4a44-a53e-bc308ff08bc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:09.190263 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-184d7342-a032-4a44-a53e-bc308ff08bc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:09.190961 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-184d7342-a032-4a44-a53e-bc308ff08bc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:09.191645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-184d7342-a032-4a44-a53e-bc308ff08bc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:09.349970 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-20457ad5-e723-4492-8106-53cd7d1c35cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:09.350995 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-20457ad5-e723-4492-8106-53cd7d1c35cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:09.362833 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20457ad5-e723-4492-8106-53cd7d1c35cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:09.363332 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20457ad5-e723-4492-8106-53cd7d1c35cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:09.363819 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20457ad5-e723-4492-8106-53cd7d1c35cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:09.364586 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20457ad5-e723-4492-8106-53cd7d1c35cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:09.365063 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20457ad5-e723-4492-8106-53cd7d1c35cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:09.366742 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-20457ad5-e723-4492-8106-53cd7d1c35cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:09.387112 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-184d7342-a032-4a44-a53e-bc308ff08bc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:09.420921 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-184d7342-a032-4a44-a53e-bc308ff08bc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1219 microversion: 2.1 time: 0.257746 Aug 29 20:33:09.430203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 23/53] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:09 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1219 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:09.526181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-20457ad5-e723-4492-8106-53cd7d1c35cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:09.534198 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-20457ad5-e723-4492-8106-53cd7d1c35cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1240 microversion: 2.1 time: 0.188108 Aug 29 20:33:09.538970 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 31/54] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:09 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1240 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:09.915977 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ba73d8cd-9138-4ef4-8efd-d0f9bd926a4d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:09.916714 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ba73d8cd-9138-4ef4-8efd-d0f9bd926a4d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:09.927803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ba73d8cd-9138-4ef4-8efd-d0f9bd926a4d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:09.928461 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ba73d8cd-9138-4ef4-8efd-d0f9bd926a4d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:09.929121 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ba73d8cd-9138-4ef4-8efd-d0f9bd926a4d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:09.930645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ba73d8cd-9138-4ef4-8efd-d0f9bd926a4d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:09.931324 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ba73d8cd-9138-4ef4-8efd-d0f9bd926a4d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:09.933068 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ba73d8cd-9138-4ef4-8efd-d0f9bd926a4d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:10.061405 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-ba73d8cd-9138-4ef4-8efd-d0f9bd926a4d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:10.073961 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ba73d8cd-9138-4ef4-8efd-d0f9bd926a4d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1226 microversion: 2.1 time: 0.162208 Aug 29 20:33:10.073961 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 24/55] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:09 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1226 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:10.446137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e583872-9d23-4506-a59c-6bad66c520df tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:10.446978 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e583872-9d23-4506-a59c-6bad66c520df tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:10.457323 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e583872-9d23-4506-a59c-6bad66c520df tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:10.468661 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e583872-9d23-4506-a59c-6bad66c520df tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:10.470336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e583872-9d23-4506-a59c-6bad66c520df tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:10.471096 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e583872-9d23-4506-a59c-6bad66c520df tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:10.471574 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e583872-9d23-4506-a59c-6bad66c520df tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:10.472036 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e583872-9d23-4506-a59c-6bad66c520df tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:10.564993 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-0d7e5f43-b097-41cb-ae03-ad110251d6f8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:10.565602 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-0d7e5f43-b097-41cb-ae03-ad110251d6f8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:10.575803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0d7e5f43-b097-41cb-ae03-ad110251d6f8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:10.579710 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0d7e5f43-b097-41cb-ae03-ad110251d6f8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:10.580236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0d7e5f43-b097-41cb-ae03-ad110251d6f8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:10.581021 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0d7e5f43-b097-41cb-ae03-ad110251d6f8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:10.581484 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0d7e5f43-b097-41cb-ae03-ad110251d6f8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:10.590512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0d7e5f43-b097-41cb-ae03-ad110251d6f8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:10.593995 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e583872-9d23-4506-a59c-6bad66c520df tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:10.607035 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e583872-9d23-4506-a59c-6bad66c520df tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1211 microversion: 2.1 time: 0.163754 Aug 29 20:33:10.609261 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 32/56] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:10 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1211 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:10.752214 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-0d7e5f43-b097-41cb-ae03-ad110251d6f8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:10.767380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-0d7e5f43-b097-41cb-ae03-ad110251d6f8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1232 microversion: 2.1 time: 0.203469 Aug 29 20:33:10.769139 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 25/57] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:10 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1232 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:11.094471 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-293be137-b3be-438c-b319-a7d75d172fe3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:11.096878 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-293be137-b3be-438c-b319-a7d75d172fe3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:11.103033 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-293be137-b3be-438c-b319-a7d75d172fe3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:11.103595 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-293be137-b3be-438c-b319-a7d75d172fe3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:11.104129 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-293be137-b3be-438c-b319-a7d75d172fe3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:11.105050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-293be137-b3be-438c-b319-a7d75d172fe3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:11.105630 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-293be137-b3be-438c-b319-a7d75d172fe3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:11.106145 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-293be137-b3be-438c-b319-a7d75d172fe3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:11.199452 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-293be137-b3be-438c-b319-a7d75d172fe3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:11.210242 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-293be137-b3be-438c-b319-a7d75d172fe3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1274 microversion: 2.1 time: 0.119533 Aug 29 20:33:11.211142 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 33/58] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:11 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:11.633655 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8e4567c2-6edb-4cc8-8321-174ffdf0f60c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:11.634283 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8e4567c2-6edb-4cc8-8321-174ffdf0f60c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:11.641352 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e4567c2-6edb-4cc8-8321-174ffdf0f60c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:11.642776 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e4567c2-6edb-4cc8-8321-174ffdf0f60c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:11.643214 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e4567c2-6edb-4cc8-8321-174ffdf0f60c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:11.644033 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e4567c2-6edb-4cc8-8321-174ffdf0f60c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:11.644496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e4567c2-6edb-4cc8-8321-174ffdf0f60c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:11.645361 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e4567c2-6edb-4cc8-8321-174ffdf0f60c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:11.737046 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8e4567c2-6edb-4cc8-8321-174ffdf0f60c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:11.775419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8e4567c2-6edb-4cc8-8321-174ffdf0f60c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1267 microversion: 2.1 time: 0.148267 Aug 29 20:33:11.776868 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 26/59] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:11 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:11.795089 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8725c059-b6ee-43e4-83bf-f65ceabe7c9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:11.797084 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8725c059-b6ee-43e4-83bf-f65ceabe7c9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:11.807406 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8725c059-b6ee-43e4-83bf-f65ceabe7c9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:11.808342 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8725c059-b6ee-43e4-83bf-f65ceabe7c9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:11.811105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8725c059-b6ee-43e4-83bf-f65ceabe7c9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:11.812258 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8725c059-b6ee-43e4-83bf-f65ceabe7c9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:11.812917 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8725c059-b6ee-43e4-83bf-f65ceabe7c9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:11.813520 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8725c059-b6ee-43e4-83bf-f65ceabe7c9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:12.028701 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8725c059-b6ee-43e4-83bf-f65ceabe7c9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:12.039297 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8725c059-b6ee-43e4-83bf-f65ceabe7c9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1288 microversion: 2.1 time: 0.252168 Aug 29 20:33:12.040041 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 34/60] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:11 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1288 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:12.233294 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f8ead74a-2bcd-4cbf-853a-ec0d205e6ebf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:12.233928 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-f8ead74a-2bcd-4cbf-853a-ec0d205e6ebf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:12.244312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f8ead74a-2bcd-4cbf-853a-ec0d205e6ebf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:12.246989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f8ead74a-2bcd-4cbf-853a-ec0d205e6ebf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:12.248068 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f8ead74a-2bcd-4cbf-853a-ec0d205e6ebf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:12.273479 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f8ead74a-2bcd-4cbf-853a-ec0d205e6ebf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:12.273841 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f8ead74a-2bcd-4cbf-853a-ec0d205e6ebf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:12.274303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f8ead74a-2bcd-4cbf-853a-ec0d205e6ebf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:12.394534 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-f8ead74a-2bcd-4cbf-853a-ec0d205e6ebf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:12.405862 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-f8ead74a-2bcd-4cbf-853a-ec0d205e6ebf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1274 microversion: 2.1 time: 0.177077 Aug 29 20:33:12.408761 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 27/61] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:12 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1274 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:12.800185 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6627100e-e57a-4474-9521-4afc5aed77da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:12.800802 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6627100e-e57a-4474-9521-4afc5aed77da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:12.806927 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6627100e-e57a-4474-9521-4afc5aed77da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:12.807482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6627100e-e57a-4474-9521-4afc5aed77da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:12.808009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6627100e-e57a-4474-9521-4afc5aed77da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:12.808652 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6627100e-e57a-4474-9521-4afc5aed77da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:12.809090 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6627100e-e57a-4474-9521-4afc5aed77da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:12.809514 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6627100e-e57a-4474-9521-4afc5aed77da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:12.882169 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6627100e-e57a-4474-9521-4afc5aed77da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:12.893657 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6627100e-e57a-4474-9521-4afc5aed77da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1267 microversion: 2.1 time: 0.097089 Aug 29 20:33:12.894579 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 35/62] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:12 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:13.060890 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a1a93d76-de69-4aa6-80e6-e5ff2825c206 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:13.062245 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a1a93d76-de69-4aa6-80e6-e5ff2825c206 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:13.070023 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a1a93d76-de69-4aa6-80e6-e5ff2825c206 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:13.070467 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a1a93d76-de69-4aa6-80e6-e5ff2825c206 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:13.070914 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a1a93d76-de69-4aa6-80e6-e5ff2825c206 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:13.071627 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a1a93d76-de69-4aa6-80e6-e5ff2825c206 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:13.072126 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a1a93d76-de69-4aa6-80e6-e5ff2825c206 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:13.072577 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a1a93d76-de69-4aa6-80e6-e5ff2825c206 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:13.141597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a1a93d76-de69-4aa6-80e6-e5ff2825c206 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:13.152934 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a1a93d76-de69-4aa6-80e6-e5ff2825c206 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1288 microversion: 2.1 time: 0.095999 Aug 29 20:33:13.153556 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 28/63] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:13 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:13.428765 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c460b876-2d54-4d67-86e7-3b7753b19235 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:13.429493 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c460b876-2d54-4d67-86e7-3b7753b19235 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:13.436045 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c460b876-2d54-4d67-86e7-3b7753b19235 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:13.436529 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c460b876-2d54-4d67-86e7-3b7753b19235 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:13.437033 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c460b876-2d54-4d67-86e7-3b7753b19235 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:13.437735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c460b876-2d54-4d67-86e7-3b7753b19235 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:13.438187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c460b876-2d54-4d67-86e7-3b7753b19235 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:13.438643 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c460b876-2d54-4d67-86e7-3b7753b19235 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:13.623043 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c460b876-2d54-4d67-86e7-3b7753b19235 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:13.632636 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c460b876-2d54-4d67-86e7-3b7753b19235 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1274 microversion: 2.1 time: 0.207653 Aug 29 20:33:13.633256 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 36/64] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:13 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:13.915726 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-556310fa-dfd4-4879-a97f-0efb999389fc tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:13.917158 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-556310fa-dfd4-4879-a97f-0efb999389fc tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:13.925193 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-556310fa-dfd4-4879-a97f-0efb999389fc tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:13.926821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-556310fa-dfd4-4879-a97f-0efb999389fc tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:13.927463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-556310fa-dfd4-4879-a97f-0efb999389fc tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:13.928380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-556310fa-dfd4-4879-a97f-0efb999389fc tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:13.932225 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-556310fa-dfd4-4879-a97f-0efb999389fc tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:13.933018 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-556310fa-dfd4-4879-a97f-0efb999389fc tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:14.019258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-556310fa-dfd4-4879-a97f-0efb999389fc tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:14.027178 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-556310fa-dfd4-4879-a97f-0efb999389fc tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1267 microversion: 2.1 time: 0.115909 Aug 29 20:33:14.027753 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 29/65] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:13 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:14.175134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-06feeb79-f7d3-4e76-bb4a-a4fdef6f1b0a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:14.175992 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-06feeb79-f7d3-4e76-bb4a-a4fdef6f1b0a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:14.183209 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06feeb79-f7d3-4e76-bb4a-a4fdef6f1b0a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:14.183886 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06feeb79-f7d3-4e76-bb4a-a4fdef6f1b0a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:14.184450 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06feeb79-f7d3-4e76-bb4a-a4fdef6f1b0a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:14.185316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06feeb79-f7d3-4e76-bb4a-a4fdef6f1b0a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:14.185871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06feeb79-f7d3-4e76-bb4a-a4fdef6f1b0a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:14.186486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-06feeb79-f7d3-4e76-bb4a-a4fdef6f1b0a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:14.275652 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-06feeb79-f7d3-4e76-bb4a-a4fdef6f1b0a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:14.312052 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-06feeb79-f7d3-4e76-bb4a-a4fdef6f1b0a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1288 microversion: 2.1 time: 0.141920 Aug 29 20:33:14.313378 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 37/66] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:14 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1288 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:14.653208 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-c116e3db-069b-41dc-97a3-c4b4487fddfb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:14.655337 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-c116e3db-069b-41dc-97a3-c4b4487fddfb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:14.665344 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c116e3db-069b-41dc-97a3-c4b4487fddfb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:14.666988 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c116e3db-069b-41dc-97a3-c4b4487fddfb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:14.668210 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c116e3db-069b-41dc-97a3-c4b4487fddfb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:14.670697 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c116e3db-069b-41dc-97a3-c4b4487fddfb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:14.671635 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c116e3db-069b-41dc-97a3-c4b4487fddfb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:14.672320 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c116e3db-069b-41dc-97a3-c4b4487fddfb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:14.764510 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-c116e3db-069b-41dc-97a3-c4b4487fddfb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:14.780931 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c116e3db-069b-41dc-97a3-c4b4487fddfb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1274 microversion: 2.1 time: 0.131759 Aug 29 20:33:14.782374 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 30/67] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:14 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:15.056660 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ed6198e7-0533-414e-b561-ce3851823707 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:15.057565 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ed6198e7-0533-414e-b561-ce3851823707 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:15.094871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed6198e7-0533-414e-b561-ce3851823707 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:15.097681 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed6198e7-0533-414e-b561-ce3851823707 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:15.098918 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed6198e7-0533-414e-b561-ce3851823707 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:15.105005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed6198e7-0533-414e-b561-ce3851823707 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:15.106731 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed6198e7-0533-414e-b561-ce3851823707 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:15.109094 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed6198e7-0533-414e-b561-ce3851823707 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:15.314641 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ed6198e7-0533-414e-b561-ce3851823707 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:15.333456 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ed6198e7-0533-414e-b561-ce3851823707 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1275 microversion: 2.1 time: 0.283993 Aug 29 20:33:15.334145 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 38/68] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:15 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1275 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:15.355771 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-670befc0-8f57-424a-bdcc-c08061465b26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:15.356947 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-670befc0-8f57-424a-bdcc-c08061465b26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:15.372470 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-670befc0-8f57-424a-bdcc-c08061465b26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:15.373426 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-670befc0-8f57-424a-bdcc-c08061465b26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:15.374228 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-670befc0-8f57-424a-bdcc-c08061465b26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:15.375405 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-670befc0-8f57-424a-bdcc-c08061465b26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:15.376135 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-670befc0-8f57-424a-bdcc-c08061465b26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:15.378007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-670befc0-8f57-424a-bdcc-c08061465b26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:15.551922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-670befc0-8f57-424a-bdcc-c08061465b26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:15.562598 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-670befc0-8f57-424a-bdcc-c08061465b26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1296 microversion: 2.1 time: 0.232742 Aug 29 20:33:15.566049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 31/69] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:15 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1296 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:15.805352 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ed807b6a-2e1d-4cec-b54e-e6ba395734cc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:15.806124 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ed807b6a-2e1d-4cec-b54e-e6ba395734cc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:15.823430 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed807b6a-2e1d-4cec-b54e-e6ba395734cc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:15.823904 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed807b6a-2e1d-4cec-b54e-e6ba395734cc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:15.824366 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed807b6a-2e1d-4cec-b54e-e6ba395734cc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:15.825051 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed807b6a-2e1d-4cec-b54e-e6ba395734cc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:15.825678 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed807b6a-2e1d-4cec-b54e-e6ba395734cc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:15.826081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed807b6a-2e1d-4cec-b54e-e6ba395734cc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:15.896644 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ed807b6a-2e1d-4cec-b54e-e6ba395734cc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:15.905832 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ed807b6a-2e1d-4cec-b54e-e6ba395734cc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1280 microversion: 2.1 time: 0.104559 Aug 29 20:33:15.906926 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 39/70] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:15 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1280 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:16.360255 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-703c0f64-164d-4702-838d-2ce302daa1c4 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:16.360864 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-703c0f64-164d-4702-838d-2ce302daa1c4 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:16.368168 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-703c0f64-164d-4702-838d-2ce302daa1c4 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:16.369183 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-703c0f64-164d-4702-838d-2ce302daa1c4 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:16.369833 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-703c0f64-164d-4702-838d-2ce302daa1c4 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:16.370674 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-703c0f64-164d-4702-838d-2ce302daa1c4 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:16.371204 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-703c0f64-164d-4702-838d-2ce302daa1c4 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:16.371700 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-703c0f64-164d-4702-838d-2ce302daa1c4 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:16.471023 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-703c0f64-164d-4702-838d-2ce302daa1c4 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:16.481082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-703c0f64-164d-4702-838d-2ce302daa1c4 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1273 microversion: 2.1 time: 0.124832 Aug 29 20:33:16.482275 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 32/71] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:16 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1273 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:16.585462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-550c0e7d-8074-4fd5-870b-a38e89c23236 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:16.586735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-550c0e7d-8074-4fd5-870b-a38e89c23236 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:16.589423 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:16.596563 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-550c0e7d-8074-4fd5-870b-a38e89c23236 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:16.597404 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-550c0e7d-8074-4fd5-870b-a38e89c23236 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:16.598292 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-550c0e7d-8074-4fd5-870b-a38e89c23236 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:16.599230 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-550c0e7d-8074-4fd5-870b-a38e89c23236 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:16.599894 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-550c0e7d-8074-4fd5-870b-a38e89c23236 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:16.600569 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-550c0e7d-8074-4fd5-870b-a38e89c23236 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:16.679842 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-550c0e7d-8074-4fd5-870b-a38e89c23236 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:16.689616 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-550c0e7d-8074-4fd5-870b-a38e89c23236 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1306 microversion: 2.1 time: 0.108932 Aug 29 20:33:16.690233 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 40/72] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:16 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:16.934437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-208a9ca5-3b48-4563-aded-a4112764c2a4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:16.935437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-208a9ca5-3b48-4563-aded-a4112764c2a4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:16.945528 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-208a9ca5-3b48-4563-aded-a4112764c2a4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:16.946280 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-208a9ca5-3b48-4563-aded-a4112764c2a4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:16.948641 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-208a9ca5-3b48-4563-aded-a4112764c2a4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:16.949785 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-208a9ca5-3b48-4563-aded-a4112764c2a4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:16.950825 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-208a9ca5-3b48-4563-aded-a4112764c2a4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:16.951862 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-208a9ca5-3b48-4563-aded-a4112764c2a4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:17.050720 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-208a9ca5-3b48-4563-aded-a4112764c2a4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:17.058903 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-208a9ca5-3b48-4563-aded-a4112764c2a4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1280 microversion: 2.1 time: 0.132305 Aug 29 20:33:17.059472 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 33/73] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:16 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1280 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:17.510486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5d8b38f2-1104-4572-b920-7768b6eabb02 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:17.512125 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5d8b38f2-1104-4572-b920-7768b6eabb02 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:17.520819 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d8b38f2-1104-4572-b920-7768b6eabb02 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:17.521370 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d8b38f2-1104-4572-b920-7768b6eabb02 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:17.522007 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d8b38f2-1104-4572-b920-7768b6eabb02 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:17.522776 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d8b38f2-1104-4572-b920-7768b6eabb02 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:17.523291 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d8b38f2-1104-4572-b920-7768b6eabb02 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:17.523889 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d8b38f2-1104-4572-b920-7768b6eabb02 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:17.602181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5d8b38f2-1104-4572-b920-7768b6eabb02 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:17.609705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5d8b38f2-1104-4572-b920-7768b6eabb02 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1273 microversion: 2.1 time: 0.106680 Aug 29 20:33:17.610272 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 41/74] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:17 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:17.713888 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e7c14692-919b-4a53-88cb-0974847f559f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:17.714691 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e7c14692-919b-4a53-88cb-0974847f559f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:17.721055 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e7c14692-919b-4a53-88cb-0974847f559f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:17.721551 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e7c14692-919b-4a53-88cb-0974847f559f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:17.721990 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e7c14692-919b-4a53-88cb-0974847f559f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:17.722732 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e7c14692-919b-4a53-88cb-0974847f559f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:17.723169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e7c14692-919b-4a53-88cb-0974847f559f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:17.723663 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e7c14692-919b-4a53-88cb-0974847f559f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:17.787860 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e7c14692-919b-4a53-88cb-0974847f559f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:17.798359 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e7c14692-919b-4a53-88cb-0974847f559f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1306 microversion: 2.1 time: 0.086837 Aug 29 20:33:17.798359 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 34/75] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:17 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1306 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:18.080604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a1f7e68f-b408-4e36-b2d5-23bee643dff6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:18.081188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a1f7e68f-b408-4e36-b2d5-23bee643dff6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:18.087294 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1f7e68f-b408-4e36-b2d5-23bee643dff6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:18.087769 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1f7e68f-b408-4e36-b2d5-23bee643dff6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:18.088229 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1f7e68f-b408-4e36-b2d5-23bee643dff6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:18.088933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1f7e68f-b408-4e36-b2d5-23bee643dff6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:18.089374 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1f7e68f-b408-4e36-b2d5-23bee643dff6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:18.089785 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a1f7e68f-b408-4e36-b2d5-23bee643dff6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:18.154275 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a1f7e68f-b408-4e36-b2d5-23bee643dff6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:18.162732 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a1f7e68f-b408-4e36-b2d5-23bee643dff6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1280 microversion: 2.1 time: 0.085957 Aug 29 20:33:18.163292 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 42/76] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:18 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:18.636809 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b7d9766a-b10e-4a41-9ec5-17994dcd76a8 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:18.638170 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b7d9766a-b10e-4a41-9ec5-17994dcd76a8 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:18.641738 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=6 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:18.643378 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=26 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:18.651898 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7d9766a-b10e-4a41-9ec5-17994dcd76a8 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:18.652956 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7d9766a-b10e-4a41-9ec5-17994dcd76a8 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:18.653620 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7d9766a-b10e-4a41-9ec5-17994dcd76a8 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:18.654854 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7d9766a-b10e-4a41-9ec5-17994dcd76a8 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:18.655377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7d9766a-b10e-4a41-9ec5-17994dcd76a8 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:18.656037 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7d9766a-b10e-4a41-9ec5-17994dcd76a8 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:18.753003 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b7d9766a-b10e-4a41-9ec5-17994dcd76a8 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:18.767493 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b7d9766a-b10e-4a41-9ec5-17994dcd76a8 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1273 microversion: 2.1 time: 0.133384 Aug 29 20:33:18.771315 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 35/77] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:18 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:18.818029 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0b59a852-ede6-4132-a3e7-d15b253351e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:18.820651 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0b59a852-ede6-4132-a3e7-d15b253351e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:18.835306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b59a852-ede6-4132-a3e7-d15b253351e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:18.840397 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b59a852-ede6-4132-a3e7-d15b253351e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:18.841363 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b59a852-ede6-4132-a3e7-d15b253351e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:18.842339 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b59a852-ede6-4132-a3e7-d15b253351e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:18.843011 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b59a852-ede6-4132-a3e7-d15b253351e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:18.844511 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b59a852-ede6-4132-a3e7-d15b253351e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:18.891290 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=10 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:19.017256 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0b59a852-ede6-4132-a3e7-d15b253351e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:19.032846 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0b59a852-ede6-4132-a3e7-d15b253351e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1294 microversion: 2.1 time: 0.219133 Aug 29 20:33:19.037357 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 43/78] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:18 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1294 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:19.184969 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-5f191fa0-2a28-4e8c-b203-361634c7482a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:19.185572 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-5f191fa0-2a28-4e8c-b203-361634c7482a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:19.199369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5f191fa0-2a28-4e8c-b203-361634c7482a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:19.199857 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5f191fa0-2a28-4e8c-b203-361634c7482a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:19.200319 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5f191fa0-2a28-4e8c-b203-361634c7482a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:19.201028 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5f191fa0-2a28-4e8c-b203-361634c7482a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:19.201480 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5f191fa0-2a28-4e8c-b203-361634c7482a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:19.201900 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5f191fa0-2a28-4e8c-b203-361634c7482a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:19.442291 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-5f191fa0-2a28-4e8c-b203-361634c7482a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:19.455544 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-5f191fa0-2a28-4e8c-b203-361634c7482a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1280 microversion: 2.1 time: 0.274674 Aug 29 20:33:19.458584 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 36/79] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:19 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1280 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:19.803601 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-294c7c2c-9167-47c2-806c-a32ed8ef8203 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:19.803601 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-294c7c2c-9167-47c2-806c-a32ed8ef8203 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:19.813569 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-294c7c2c-9167-47c2-806c-a32ed8ef8203 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:19.814356 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-294c7c2c-9167-47c2-806c-a32ed8ef8203 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:19.815614 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-294c7c2c-9167-47c2-806c-a32ed8ef8203 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:19.816555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-294c7c2c-9167-47c2-806c-a32ed8ef8203 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:19.817166 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-294c7c2c-9167-47c2-806c-a32ed8ef8203 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:19.820199 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-294c7c2c-9167-47c2-806c-a32ed8ef8203 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:20.064812 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-50d0cedf-57b2-4d46-966f-0872488064f0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:20.065593 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-50d0cedf-57b2-4d46-966f-0872488064f0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:20.068774 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:20.097979 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-50d0cedf-57b2-4d46-966f-0872488064f0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:20.098491 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-50d0cedf-57b2-4d46-966f-0872488064f0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:20.098945 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-50d0cedf-57b2-4d46-966f-0872488064f0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:20.106517 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-50d0cedf-57b2-4d46-966f-0872488064f0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:20.107006 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-50d0cedf-57b2-4d46-966f-0872488064f0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:20.112672 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-50d0cedf-57b2-4d46-966f-0872488064f0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:20.419472 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-50d0cedf-57b2-4d46-966f-0872488064f0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:20.428229 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-50d0cedf-57b2-4d46-966f-0872488064f0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1294 microversion: 2.1 time: 0.368019 Aug 29 20:33:20.440593 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 37/80] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:20 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1294 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:20.496861 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-080f0a2e-d200-48be-befb-266f531eec02 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:20.497482 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-080f0a2e-d200-48be-befb-266f531eec02 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:20.520788 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-080f0a2e-d200-48be-befb-266f531eec02 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:20.527884 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-080f0a2e-d200-48be-befb-266f531eec02 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:20.528449 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-080f0a2e-d200-48be-befb-266f531eec02 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:20.529274 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-080f0a2e-d200-48be-befb-266f531eec02 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:20.531158 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-080f0a2e-d200-48be-befb-266f531eec02 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:20.535134 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-080f0a2e-d200-48be-befb-266f531eec02 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:20.593433 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=100 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:20.858228 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-294c7c2c-9167-47c2-806c-a32ed8ef8203 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:20.889943 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-294c7c2c-9167-47c2-806c-a32ed8ef8203 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1273 microversion: 2.1 time: 1.094445 Aug 29 20:33:20.890512 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 44/81] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:19 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1273 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:20.955066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-080f0a2e-d200-48be-befb-266f531eec02 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:20.968748 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-080f0a2e-d200-48be-befb-266f531eec02 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1280 microversion: 2.1 time: 0.475847 Aug 29 20:33:20.983023 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 38/82] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:20 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1280 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:21.452156 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-efda31b0-3bc8-41b9-83cd-c21c5e27bb44 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:21.453578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-efda31b0-3bc8-41b9-83cd-c21c5e27bb44 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:21.464908 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-efda31b0-3bc8-41b9-83cd-c21c5e27bb44 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:21.468698 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-efda31b0-3bc8-41b9-83cd-c21c5e27bb44 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:21.470439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-efda31b0-3bc8-41b9-83cd-c21c5e27bb44 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:21.471533 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-efda31b0-3bc8-41b9-83cd-c21c5e27bb44 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:21.473384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-efda31b0-3bc8-41b9-83cd-c21c5e27bb44 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:21.474013 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-efda31b0-3bc8-41b9-83cd-c21c5e27bb44 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:21.767031 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-efda31b0-3bc8-41b9-83cd-c21c5e27bb44 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:21.804481 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-efda31b0-3bc8-41b9-83cd-c21c5e27bb44 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1294 microversion: 2.1 time: 0.352722 Aug 29 20:33:21.810448 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 39/83] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:21 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1294 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:21.861330 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-fbcf5a30-8a1a-4682-8bb6-bce7b438d147 req-73f18732-4d05-4b21-ab5c-ea8aa7557101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db93852-3c79-43ac-8757-a41602e8bc53", "tag": "83aab753-4372-4b2f-a578-8ecea2f99be1"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:21.929610 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1417293d-2c5d-41a6-8515-f4392b29fd6c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:21.931155 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1417293d-2c5d-41a6-8515-f4392b29fd6c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:21.933416 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fbcf5a30-8a1a-4682-8bb6-bce7b438d147 req-73f18732-4d05-4b21-ab5c-ea8aa7557101 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:21.940910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fbcf5a30-8a1a-4682-8bb6-bce7b438d147 req-73f18732-4d05-4b21-ab5c-ea8aa7557101 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:21.941565 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fbcf5a30-8a1a-4682-8bb6-bce7b438d147 req-73f18732-4d05-4b21-ab5c-ea8aa7557101 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:21.943887 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1417293d-2c5d-41a6-8515-f4392b29fd6c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:21.946332 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1417293d-2c5d-41a6-8515-f4392b29fd6c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:21.947484 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1417293d-2c5d-41a6-8515-f4392b29fd6c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:21.948919 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1417293d-2c5d-41a6-8515-f4392b29fd6c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:21.949530 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1417293d-2c5d-41a6-8515-f4392b29fd6c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:21.950274 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1417293d-2c5d-41a6-8515-f4392b29fd6c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:22.022447 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:22.025785 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-fbcf5a30-8a1a-4682-8bb6-bce7b438d147 req-73f18732-4d05-4b21-ab5c-ea8aa7557101 service nova] Creating event network-changed:83aab753-4372-4b2f-a578-8ecea2f99be1 for instance 3db93852-3c79-43ac-8757-a41602e8bc53 on hv-cinder-85426 Aug 29 20:33:22.026536 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fbcf5a30-8a1a-4682-8bb6-bce7b438d147 req-73f18732-4d05-4b21-ab5c-ea8aa7557101 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 20:33:22.031567 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-fbcf5a30-8a1a-4682-8bb6-bce7b438d147 req-73f18732-4d05-4b21-ab5c-ea8aa7557101 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 20:33:22.041141 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e766eea6-7ced-48de-abb0-ad5007d05296 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:22.045534 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e766eea6-7ced-48de-abb0-ad5007d05296 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:22.052854 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e766eea6-7ced-48de-abb0-ad5007d05296 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:22.054314 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e766eea6-7ced-48de-abb0-ad5007d05296 None None] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:22.055326 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e766eea6-7ced-48de-abb0-ad5007d05296 None None] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:22.056184 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e766eea6-7ced-48de-abb0-ad5007d05296 None None] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:22.090787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.compute.rpcapi [None req-e766eea6-7ced-48de-abb0-ad5007d05296 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 20:33:22.102081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e766eea6-7ced-48de-abb0-ad5007d05296 None None] Releasing lock "compute-rpcapi-router" {{(pid=127028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 20:33:22.135619 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e766eea6-7ced-48de-abb0-ad5007d05296 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.702299 Aug 29 20:33:22.136542 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 45/84] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:22.154652 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f7277516-3ec7-435d-b96b-f7b69777dbdd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:22.156080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f7277516-3ec7-435d-b96b-f7b69777dbdd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:22.200420 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7277516-3ec7-435d-b96b-f7b69777dbdd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:22.213964 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7277516-3ec7-435d-b96b-f7b69777dbdd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:22.214963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7277516-3ec7-435d-b96b-f7b69777dbdd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:22.220671 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7277516-3ec7-435d-b96b-f7b69777dbdd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:22.224604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7277516-3ec7-435d-b96b-f7b69777dbdd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:22.225198 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7277516-3ec7-435d-b96b-f7b69777dbdd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:22.528767 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1417293d-2c5d-41a6-8515-f4392b29fd6c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:22.560975 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1417293d-2c5d-41a6-8515-f4392b29fd6c tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1273 microversion: 2.1 time: 0.638755 Aug 29 20:33:22.585384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 40/85] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:21 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1273 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:22.832780 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-797f6e80-3c85-464b-9e64-589681e0258a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:22.833940 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-797f6e80-3c85-464b-9e64-589681e0258a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:22.851957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-797f6e80-3c85-464b-9e64-589681e0258a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:22.854336 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-797f6e80-3c85-464b-9e64-589681e0258a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:22.855862 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-797f6e80-3c85-464b-9e64-589681e0258a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:22.858226 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-797f6e80-3c85-464b-9e64-589681e0258a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:22.860949 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-797f6e80-3c85-464b-9e64-589681e0258a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:22.864565 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-797f6e80-3c85-464b-9e64-589681e0258a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:23.743503 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f7277516-3ec7-435d-b96b-f7b69777dbdd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:23.753747 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f7277516-3ec7-435d-b96b-f7b69777dbdd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 1.614956 Aug 29 20:33:23.754652 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 46/86] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:22 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:23.770664 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-797f6e80-3c85-464b-9e64-589681e0258a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:23.773169 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e2f7f033-c199-4685-92e3-f83a8683bf43 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:23.773889 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e2f7f033-c199-4685-92e3-f83a8683bf43 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:23.781859 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2f7f033-c199-4685-92e3-f83a8683bf43 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:23.782524 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2f7f033-c199-4685-92e3-f83a8683bf43 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:23.783100 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2f7f033-c199-4685-92e3-f83a8683bf43 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:23.784538 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2f7f033-c199-4685-92e3-f83a8683bf43 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:23.785184 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2f7f033-c199-4685-92e3-f83a8683bf43 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:23.786031 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-797f6e80-3c85-464b-9e64-589681e0258a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.958434 Aug 29 20:33:23.786830 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e2f7f033-c199-4685-92e3-f83a8683bf43 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:23.797036 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 41/87] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:22 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:23.967037 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e2f7f033-c199-4685-92e3-f83a8683bf43 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:23.976016 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e2f7f033-c199-4685-92e3-f83a8683bf43 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.220302 Aug 29 20:33:23.976648 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 47/88] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:23 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:24.775660 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-05d77860-3a91-43a6-a8ee-57e153c117b9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:24.776671 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-05d77860-3a91-43a6-a8ee-57e153c117b9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:24.788282 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-05d77860-3a91-43a6-a8ee-57e153c117b9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:24.788282 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-05d77860-3a91-43a6-a8ee-57e153c117b9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:24.788282 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-05d77860-3a91-43a6-a8ee-57e153c117b9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:24.788282 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-05d77860-3a91-43a6-a8ee-57e153c117b9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:24.788688 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-05d77860-3a91-43a6-a8ee-57e153c117b9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:24.788688 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-05d77860-3a91-43a6-a8ee-57e153c117b9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:24.810574 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d54841c9-1a69-42f1-97d9-a921ed8b92d3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:24.811903 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d54841c9-1a69-42f1-97d9-a921ed8b92d3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:24.820631 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d54841c9-1a69-42f1-97d9-a921ed8b92d3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:24.821396 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d54841c9-1a69-42f1-97d9-a921ed8b92d3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:24.821982 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d54841c9-1a69-42f1-97d9-a921ed8b92d3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:24.823271 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d54841c9-1a69-42f1-97d9-a921ed8b92d3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:24.823900 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d54841c9-1a69-42f1-97d9-a921ed8b92d3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:24.824634 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d54841c9-1a69-42f1-97d9-a921ed8b92d3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:24.962132 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-05d77860-3a91-43a6-a8ee-57e153c117b9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:24.972377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-05d77860-3a91-43a6-a8ee-57e153c117b9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.201505 Aug 29 20:33:24.975984 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 42/89] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:24 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:24.999323 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-c4b63a60-6129-4019-8dbd-51714033cc88 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:24.999992 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-c4b63a60-6129-4019-8dbd-51714033cc88 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:25.009972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c4b63a60-6129-4019-8dbd-51714033cc88 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:25.013020 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c4b63a60-6129-4019-8dbd-51714033cc88 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:25.013995 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c4b63a60-6129-4019-8dbd-51714033cc88 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:25.015710 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c4b63a60-6129-4019-8dbd-51714033cc88 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:25.017031 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c4b63a60-6129-4019-8dbd-51714033cc88 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:25.017824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c4b63a60-6129-4019-8dbd-51714033cc88 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:25.023465 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-d54841c9-1a69-42f1-97d9-a921ed8b92d3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:25.032639 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d54841c9-1a69-42f1-97d9-a921ed8b92d3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.228298 Aug 29 20:33:25.047128 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 48/90] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:24 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:25.258570 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-c4b63a60-6129-4019-8dbd-51714033cc88 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:25.277191 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c4b63a60-6129-4019-8dbd-51714033cc88 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.271499 Aug 29 20:33:25.279399 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 43/91] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:24 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:25.994740 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c47471a6-0613-4154-930f-248a6729270d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:25.996076 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c47471a6-0613-4154-930f-248a6729270d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:26.003561 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c47471a6-0613-4154-930f-248a6729270d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:26.004325 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c47471a6-0613-4154-930f-248a6729270d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:26.004910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c47471a6-0613-4154-930f-248a6729270d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:26.005769 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c47471a6-0613-4154-930f-248a6729270d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:26.006362 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c47471a6-0613-4154-930f-248a6729270d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:26.006928 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c47471a6-0613-4154-930f-248a6729270d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:26.055062 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6840658f-2aae-49cd-8b91-65d6466ce45b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:26.055784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6840658f-2aae-49cd-8b91-65d6466ce45b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:26.064060 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6840658f-2aae-49cd-8b91-65d6466ce45b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:26.066801 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6840658f-2aae-49cd-8b91-65d6466ce45b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:26.067275 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6840658f-2aae-49cd-8b91-65d6466ce45b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:26.068145 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6840658f-2aae-49cd-8b91-65d6466ce45b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:26.068617 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6840658f-2aae-49cd-8b91-65d6466ce45b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:26.069046 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6840658f-2aae-49cd-8b91-65d6466ce45b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:26.212217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c47471a6-0613-4154-930f-248a6729270d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:26.220452 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c47471a6-0613-4154-930f-248a6729270d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.229608 Aug 29 20:33:26.221122 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 49/92] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:25 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:26.293609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-6840658f-2aae-49cd-8b91-65d6466ce45b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:26.307436 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d446dd65-f6a7-4a2e-b37f-f32ca95b32cd tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:26.308107 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d446dd65-f6a7-4a2e-b37f-f32ca95b32cd tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:26.320878 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6840658f-2aae-49cd-8b91-65d6466ce45b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.266918 Aug 29 20:33:26.324555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d446dd65-f6a7-4a2e-b37f-f32ca95b32cd tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:26.324798 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 44/93] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:26 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:26.327383 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d446dd65-f6a7-4a2e-b37f-f32ca95b32cd tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:26.327890 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d446dd65-f6a7-4a2e-b37f-f32ca95b32cd tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:26.328657 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d446dd65-f6a7-4a2e-b37f-f32ca95b32cd tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:26.329106 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d446dd65-f6a7-4a2e-b37f-f32ca95b32cd tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:26.330080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d446dd65-f6a7-4a2e-b37f-f32ca95b32cd tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:26.488592 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-d446dd65-f6a7-4a2e-b37f-f32ca95b32cd tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:26.517241 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d446dd65-f6a7-4a2e-b37f-f32ca95b32cd tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.214159 Aug 29 20:33:26.532369 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 50/94] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:26 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:27.243124 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8619044a-e05e-4a9a-99ba-6f55a4733e96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:27.243732 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8619044a-e05e-4a9a-99ba-6f55a4733e96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:27.256836 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8619044a-e05e-4a9a-99ba-6f55a4733e96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:27.257785 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8619044a-e05e-4a9a-99ba-6f55a4733e96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:27.258411 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8619044a-e05e-4a9a-99ba-6f55a4733e96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:27.259357 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8619044a-e05e-4a9a-99ba-6f55a4733e96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:27.260333 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8619044a-e05e-4a9a-99ba-6f55a4733e96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:27.262338 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8619044a-e05e-4a9a-99ba-6f55a4733e96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:27.351378 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-db10318d-6890-4cc2-a7e4-61a4c0fd936b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:27.352449 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-db10318d-6890-4cc2-a7e4-61a4c0fd936b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:27.381164 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db10318d-6890-4cc2-a7e4-61a4c0fd936b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:27.381953 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db10318d-6890-4cc2-a7e4-61a4c0fd936b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:27.382604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db10318d-6890-4cc2-a7e4-61a4c0fd936b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:27.383597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db10318d-6890-4cc2-a7e4-61a4c0fd936b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:27.387541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db10318d-6890-4cc2-a7e4-61a4c0fd936b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:27.388540 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-db10318d-6890-4cc2-a7e4-61a4c0fd936b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:27.562707 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8619044a-e05e-4a9a-99ba-6f55a4733e96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:27.587859 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8619044a-e05e-4a9a-99ba-6f55a4733e96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.344246 Aug 29 20:33:27.590070 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 45/95] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:27 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:27.603523 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d5d42bdb-a29e-45e8-8603-629aecb46058 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:27.604190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d5d42bdb-a29e-45e8-8603-629aecb46058 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:27.636935 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d5d42bdb-a29e-45e8-8603-629aecb46058 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:27.639467 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d5d42bdb-a29e-45e8-8603-629aecb46058 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:27.640028 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d5d42bdb-a29e-45e8-8603-629aecb46058 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:27.649154 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d5d42bdb-a29e-45e8-8603-629aecb46058 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:27.649803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d5d42bdb-a29e-45e8-8603-629aecb46058 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:27.650386 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d5d42bdb-a29e-45e8-8603-629aecb46058 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:27.687905 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-db10318d-6890-4cc2-a7e4-61a4c0fd936b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:27.709267 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-db10318d-6890-4cc2-a7e4-61a4c0fd936b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.367248 Aug 29 20:33:27.711721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 51/96] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:27 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:28.033928 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d5d42bdb-a29e-45e8-8603-629aecb46058 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:28.053791 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d5d42bdb-a29e-45e8-8603-629aecb46058 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.462012 Aug 29 20:33:28.056723 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 46/97] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:27 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:28.609837 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ed67cb3e-dcb9-4970-a5bf-9049c65ae5a5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:28.610517 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ed67cb3e-dcb9-4970-a5bf-9049c65ae5a5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:28.613315 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:28.630761 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed67cb3e-dcb9-4970-a5bf-9049c65ae5a5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:28.631250 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed67cb3e-dcb9-4970-a5bf-9049c65ae5a5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:28.631682 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed67cb3e-dcb9-4970-a5bf-9049c65ae5a5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:28.632414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed67cb3e-dcb9-4970-a5bf-9049c65ae5a5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:28.632867 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed67cb3e-dcb9-4970-a5bf-9049c65ae5a5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:28.633290 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ed67cb3e-dcb9-4970-a5bf-9049c65ae5a5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:28.735209 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d9f45557-c91e-4178-b21e-0fdce13ae2e8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:28.736675 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d9f45557-c91e-4178-b21e-0fdce13ae2e8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:28.743912 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d9f45557-c91e-4178-b21e-0fdce13ae2e8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:28.748532 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d9f45557-c91e-4178-b21e-0fdce13ae2e8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:28.749294 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d9f45557-c91e-4178-b21e-0fdce13ae2e8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:28.751608 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d9f45557-c91e-4178-b21e-0fdce13ae2e8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:28.752313 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d9f45557-c91e-4178-b21e-0fdce13ae2e8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:28.760237 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d9f45557-c91e-4178-b21e-0fdce13ae2e8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:28.905973 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ed67cb3e-dcb9-4970-a5bf-9049c65ae5a5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:28.918361 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ed67cb3e-dcb9-4970-a5bf-9049c65ae5a5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.312631 Aug 29 20:33:28.919388 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 52/98] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:28 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:29.089876 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eac0493c-2ed9-4388-947c-cfc516017cc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:29.092862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eac0493c-2ed9-4388-947c-cfc516017cc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:29.112429 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d9f45557-c91e-4178-b21e-0fdce13ae2e8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:29.129285 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eac0493c-2ed9-4388-947c-cfc516017cc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:29.130409 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eac0493c-2ed9-4388-947c-cfc516017cc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:29.133194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d9f45557-c91e-4178-b21e-0fdce13ae2e8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.400586 Aug 29 20:33:29.133869 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eac0493c-2ed9-4388-947c-cfc516017cc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:29.145086 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eac0493c-2ed9-4388-947c-cfc516017cc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:29.145086 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eac0493c-2ed9-4388-947c-cfc516017cc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:29.145086 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eac0493c-2ed9-4388-947c-cfc516017cc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:29.147494 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 47/99] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:28 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:29.945172 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e0252c63-9cdd-49e3-99fc-56c91f5e1f81 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:29.946503 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e0252c63-9cdd-49e3-99fc-56c91f5e1f81 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:29.967334 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e0252c63-9cdd-49e3-99fc-56c91f5e1f81 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:29.970665 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e0252c63-9cdd-49e3-99fc-56c91f5e1f81 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:29.971539 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e0252c63-9cdd-49e3-99fc-56c91f5e1f81 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:29.973294 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e0252c63-9cdd-49e3-99fc-56c91f5e1f81 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:29.976933 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e0252c63-9cdd-49e3-99fc-56c91f5e1f81 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:29.979190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e0252c63-9cdd-49e3-99fc-56c91f5e1f81 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:30.739177 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e0252c63-9cdd-49e3-99fc-56c91f5e1f81 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:30.750330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e0252c63-9cdd-49e3-99fc-56c91f5e1f81 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.810927 Aug 29 20:33:30.758667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 48/100] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:29 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:30.763047 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2e48e553-20dd-4664-9eb1-38ce9c61797f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:30.768135 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2e48e553-20dd-4664-9eb1-38ce9c61797f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:30.781898 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2e48e553-20dd-4664-9eb1-38ce9c61797f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:30.785821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2e48e553-20dd-4664-9eb1-38ce9c61797f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:30.790888 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2e48e553-20dd-4664-9eb1-38ce9c61797f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:30.792258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2e48e553-20dd-4664-9eb1-38ce9c61797f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:30.793208 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2e48e553-20dd-4664-9eb1-38ce9c61797f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:30.793999 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2e48e553-20dd-4664-9eb1-38ce9c61797f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:31.154048 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-eac0493c-2ed9-4388-947c-cfc516017cc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:31.154854 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2e48e553-20dd-4664-9eb1-38ce9c61797f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:31.177999 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eac0493c-2ed9-4388-947c-cfc516017cc6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 2.090688 Aug 29 20:33:31.179262 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2e48e553-20dd-4664-9eb1-38ce9c61797f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.424402 Aug 29 20:33:31.180646 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 53/101] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:29 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:31.201427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 49/102] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:30 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:31.789334 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-402672da-c332-429f-a7d5-43d9be68dae2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:31.790124 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-402672da-c332-429f-a7d5-43d9be68dae2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:31.808433 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-402672da-c332-429f-a7d5-43d9be68dae2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:31.809148 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-402672da-c332-429f-a7d5-43d9be68dae2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:31.809812 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-402672da-c332-429f-a7d5-43d9be68dae2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:31.810535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-402672da-c332-429f-a7d5-43d9be68dae2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:31.811014 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-402672da-c332-429f-a7d5-43d9be68dae2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:31.816874 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-402672da-c332-429f-a7d5-43d9be68dae2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:32.102970 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:32.207863 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-eeb773cf-1392-45bc-98fa-eeb0f89f6d72 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:32.208624 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-eeb773cf-1392-45bc-98fa-eeb0f89f6d72 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:32.222345 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eeb773cf-1392-45bc-98fa-eeb0f89f6d72 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:32.223536 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eeb773cf-1392-45bc-98fa-eeb0f89f6d72 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:32.224000 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eeb773cf-1392-45bc-98fa-eeb0f89f6d72 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:32.225708 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eeb773cf-1392-45bc-98fa-eeb0f89f6d72 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:32.226165 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eeb773cf-1392-45bc-98fa-eeb0f89f6d72 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:32.226581 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eeb773cf-1392-45bc-98fa-eeb0f89f6d72 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:32.604614 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-eeb773cf-1392-45bc-98fa-eeb0f89f6d72 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:32.613050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-402672da-c332-429f-a7d5-43d9be68dae2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:32.622204 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-eeb773cf-1392-45bc-98fa-eeb0f89f6d72 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.418911 Aug 29 20:33:32.632967 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 50/103] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:32 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:32.633055 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-402672da-c332-429f-a7d5-43d9be68dae2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.848403 Aug 29 20:33:32.640862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 54/104] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:31 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:32.653340 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-272393e5-7be0-4375-9802-4472c5c32104 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:32.654037 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-272393e5-7be0-4375-9802-4472c5c32104 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:32.660650 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-272393e5-7be0-4375-9802-4472c5c32104 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:32.661222 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-272393e5-7be0-4375-9802-4472c5c32104 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:32.661664 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-272393e5-7be0-4375-9802-4472c5c32104 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:32.662365 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-272393e5-7be0-4375-9802-4472c5c32104 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:32.662869 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-272393e5-7be0-4375-9802-4472c5c32104 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:32.663279 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-272393e5-7be0-4375-9802-4472c5c32104 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:32.848273 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-272393e5-7be0-4375-9802-4472c5c32104 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:32.857878 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-272393e5-7be0-4375-9802-4472c5c32104 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.227239 Aug 29 20:33:32.858458 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 51/105] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:32 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:33.631089 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-63bd1757-8836-453e-baf5-bd38f9c17e04 req-78d3df08-6170-4d6e-a951-93a143cba113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdda123-bbf1-425b-b690-2d0919df08a2", "tag": "98948443-f8c1-415f-85ca-da7736524db5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:33.650999 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b438f122-c4fd-4451-8fe1-19d1ff3f3cd5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:33.653508 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b438f122-c4fd-4451-8fe1-19d1ff3f3cd5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:33.662607 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-63bd1757-8836-453e-baf5-bd38f9c17e04 req-78d3df08-6170-4d6e-a951-93a143cba113 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:33.667607 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-63bd1757-8836-453e-baf5-bd38f9c17e04 req-78d3df08-6170-4d6e-a951-93a143cba113 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:33.669377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b438f122-c4fd-4451-8fe1-19d1ff3f3cd5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:33.671238 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-63bd1757-8836-453e-baf5-bd38f9c17e04 req-78d3df08-6170-4d6e-a951-93a143cba113 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:33.671665 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b438f122-c4fd-4451-8fe1-19d1ff3f3cd5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:33.672776 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b438f122-c4fd-4451-8fe1-19d1ff3f3cd5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:33.675119 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b438f122-c4fd-4451-8fe1-19d1ff3f3cd5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:33.679709 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b438f122-c4fd-4451-8fe1-19d1ff3f3cd5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:33.680553 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b438f122-c4fd-4451-8fe1-19d1ff3f3cd5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:33.734336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-63bd1757-8836-453e-baf5-bd38f9c17e04 req-78d3df08-6170-4d6e-a951-93a143cba113 service nova] Creating event network-changed:98948443-f8c1-415f-85ca-da7736524db5 for instance dfdda123-bbf1-425b-b690-2d0919df08a2 on hv-cinder-85426 Aug 29 20:33:33.756902 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-63bd1757-8836-453e-baf5-bd38f9c17e04 req-78d3df08-6170-4d6e-a951-93a143cba113 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248879 Aug 29 20:33:33.771260 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 55/106] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:33.792061 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cc4e42aa-2ce6-46b8-8cae-23180deb8b54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:33.792977 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cc4e42aa-2ce6-46b8-8cae-23180deb8b54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:33.827438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc4e42aa-2ce6-46b8-8cae-23180deb8b54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:33.840912 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc4e42aa-2ce6-46b8-8cae-23180deb8b54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:33.841553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc4e42aa-2ce6-46b8-8cae-23180deb8b54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:33.843263 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc4e42aa-2ce6-46b8-8cae-23180deb8b54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:33.844473 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc4e42aa-2ce6-46b8-8cae-23180deb8b54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:33.846261 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cc4e42aa-2ce6-46b8-8cae-23180deb8b54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:34.147341 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b438f122-c4fd-4451-8fe1-19d1ff3f3cd5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:34.158622 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b438f122-c4fd-4451-8fe1-19d1ff3f3cd5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.510898 Aug 29 20:33:34.159697 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 52/107] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:33 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:34.164674 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-187cb2ca-34f8-4fd0-88b6-6fd52c6b2cb3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:34.165460 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-187cb2ca-34f8-4fd0-88b6-6fd52c6b2cb3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:34.177849 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-187cb2ca-34f8-4fd0-88b6-6fd52c6b2cb3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:34.180685 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-187cb2ca-34f8-4fd0-88b6-6fd52c6b2cb3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:34.181207 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-187cb2ca-34f8-4fd0-88b6-6fd52c6b2cb3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:34.181964 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-187cb2ca-34f8-4fd0-88b6-6fd52c6b2cb3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:34.183093 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-187cb2ca-34f8-4fd0-88b6-6fd52c6b2cb3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:34.183544 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-187cb2ca-34f8-4fd0-88b6-6fd52c6b2cb3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:34.389727 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-187cb2ca-34f8-4fd0-88b6-6fd52c6b2cb3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:34.400834 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-187cb2ca-34f8-4fd0-88b6-6fd52c6b2cb3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.239792 Aug 29 20:33:34.401484 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 53/108] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:34 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:34.656760 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-cc4e42aa-2ce6-46b8-8cae-23180deb8b54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:34.668726 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cc4e42aa-2ce6-46b8-8cae-23180deb8b54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.894338 Aug 29 20:33:34.670081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 56/109] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:33 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:35.182856 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-af326eb9-75f2-4d8a-9a23-68f9ed7f79b7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:35.184202 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-af326eb9-75f2-4d8a-9a23-68f9ed7f79b7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:35.194456 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-af326eb9-75f2-4d8a-9a23-68f9ed7f79b7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:35.196471 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-af326eb9-75f2-4d8a-9a23-68f9ed7f79b7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:35.198548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-af326eb9-75f2-4d8a-9a23-68f9ed7f79b7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:35.199793 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-af326eb9-75f2-4d8a-9a23-68f9ed7f79b7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:35.201143 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-af326eb9-75f2-4d8a-9a23-68f9ed7f79b7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:35.202408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-af326eb9-75f2-4d8a-9a23-68f9ed7f79b7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:35.422149 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb756a9d-cceb-4584-b0d1-2e58de8017e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:35.422771 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fb756a9d-cceb-4584-b0d1-2e58de8017e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:35.434823 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb756a9d-cceb-4584-b0d1-2e58de8017e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:35.444745 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb756a9d-cceb-4584-b0d1-2e58de8017e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:35.445744 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb756a9d-cceb-4584-b0d1-2e58de8017e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:35.447859 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb756a9d-cceb-4584-b0d1-2e58de8017e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:35.450343 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb756a9d-cceb-4584-b0d1-2e58de8017e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:35.450958 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fb756a9d-cceb-4584-b0d1-2e58de8017e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:35.530443 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-af326eb9-75f2-4d8a-9a23-68f9ed7f79b7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:35.544232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-af326eb9-75f2-4d8a-9a23-68f9ed7f79b7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.366324 Aug 29 20:33:35.546857 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 54/110] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:35 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:35.696294 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9c87b222-68ec-4797-ab9c-f563fa903c19 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:35.697232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9c87b222-68ec-4797-ab9c-f563fa903c19 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:35.704554 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c87b222-68ec-4797-ab9c-f563fa903c19 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:35.705317 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c87b222-68ec-4797-ab9c-f563fa903c19 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:35.705818 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c87b222-68ec-4797-ab9c-f563fa903c19 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:35.706623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c87b222-68ec-4797-ab9c-f563fa903c19 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:35.708074 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c87b222-68ec-4797-ab9c-f563fa903c19 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:35.708821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c87b222-68ec-4797-ab9c-f563fa903c19 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:35.715001 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=100 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:36.108881 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-fb756a9d-cceb-4584-b0d1-2e58de8017e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:36.125807 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fb756a9d-cceb-4584-b0d1-2e58de8017e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.707384 Aug 29 20:33:36.132545 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 57/111] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:35 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:36.139670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-0139de9f-7e2a-4a96-bb56-22ed1bed2442 req-b56b04ea-0e51-4fe7-9704-daa53bc08531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "150aa4a3-390c-4eb1-91ea-236f55e59e57", "tag": "2cdd540d-17e7-4430-81b9-58cbfc6bfafc"}, {"name": "network-changed", "server_uuid": "5dc0cdac-77c6-4130-b162-e04f6a61c60c", "tag": "d8d1277a-533e-438a-99e5-6a4962cfe90d"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:36.144183 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9c87b222-68ec-4797-ab9c-f563fa903c19 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:36.168008 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9c87b222-68ec-4797-ab9c-f563fa903c19 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.476339 Aug 29 20:33:36.171621 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 55/112] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:35 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:36.182828 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0139de9f-7e2a-4a96-bb56-22ed1bed2442 req-b56b04ea-0e51-4fe7-9704-daa53bc08531 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:36.183318 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0139de9f-7e2a-4a96-bb56-22ed1bed2442 req-b56b04ea-0e51-4fe7-9704-daa53bc08531 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:36.183745 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0139de9f-7e2a-4a96-bb56-22ed1bed2442 req-b56b04ea-0e51-4fe7-9704-daa53bc08531 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:36.236795 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-0139de9f-7e2a-4a96-bb56-22ed1bed2442 req-b56b04ea-0e51-4fe7-9704-daa53bc08531 service nova] Creating event network-changed:2cdd540d-17e7-4430-81b9-58cbfc6bfafc for instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 on hv-cinder-85426 Aug 29 20:33:36.237586 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-0139de9f-7e2a-4a96-bb56-22ed1bed2442 req-b56b04ea-0e51-4fe7-9704-daa53bc08531 service nova] Creating event network-changed:d8d1277a-533e-438a-99e5-6a4962cfe90d for instance 5dc0cdac-77c6-4130-b162-e04f6a61c60c on hv-cinder-85426 Aug 29 20:33:36.255824 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-0139de9f-7e2a-4a96-bb56-22ed1bed2442 req-b56b04ea-0e51-4fe7-9704-daa53bc08531 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.121567 Aug 29 20:33:36.258575 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 58/113] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:36.566553 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-52ab8bfd-2daf-4e5d-be4b-e4fad8085000 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:36.567402 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-52ab8bfd-2daf-4e5d-be4b-e4fad8085000 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:36.574639 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-52ab8bfd-2daf-4e5d-be4b-e4fad8085000 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:36.575213 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-52ab8bfd-2daf-4e5d-be4b-e4fad8085000 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:36.575827 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-52ab8bfd-2daf-4e5d-be4b-e4fad8085000 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:36.576624 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-52ab8bfd-2daf-4e5d-be4b-e4fad8085000 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:36.577147 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-52ab8bfd-2daf-4e5d-be4b-e4fad8085000 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:36.577922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-52ab8bfd-2daf-4e5d-be4b-e4fad8085000 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:36.743232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-52ab8bfd-2daf-4e5d-be4b-e4fad8085000 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:36.751415 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-52ab8bfd-2daf-4e5d-be4b-e4fad8085000 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.188612 Aug 29 20:33:36.752012 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 56/114] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:36 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:37.153105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d812e622-18f4-43df-a976-7862fa6793b9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:37.153971 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d812e622-18f4-43df-a976-7862fa6793b9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:37.161012 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d812e622-18f4-43df-a976-7862fa6793b9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:37.161560 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d812e622-18f4-43df-a976-7862fa6793b9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:37.162852 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d812e622-18f4-43df-a976-7862fa6793b9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:37.163645 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d812e622-18f4-43df-a976-7862fa6793b9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:37.164617 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d812e622-18f4-43df-a976-7862fa6793b9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:37.165365 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d812e622-18f4-43df-a976-7862fa6793b9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:37.200065 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-cc925d3c-43e0-4a92-80af-98587c0c3804 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:37.200826 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-cc925d3c-43e0-4a92-80af-98587c0c3804 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:37.210161 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cc925d3c-43e0-4a92-80af-98587c0c3804 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:37.210747 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cc925d3c-43e0-4a92-80af-98587c0c3804 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:37.218755 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cc925d3c-43e0-4a92-80af-98587c0c3804 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:37.219574 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cc925d3c-43e0-4a92-80af-98587c0c3804 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:37.220241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cc925d3c-43e0-4a92-80af-98587c0c3804 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:37.220932 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cc925d3c-43e0-4a92-80af-98587c0c3804 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:37.385050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-d812e622-18f4-43df-a976-7862fa6793b9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:37.393753 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d812e622-18f4-43df-a976-7862fa6793b9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.245759 Aug 29 20:33:37.395662 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 59/115] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:37 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:37.498899 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-cc925d3c-43e0-4a92-80af-98587c0c3804 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:37.509474 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-cc925d3c-43e0-4a92-80af-98587c0c3804 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.314334 Aug 29 20:33:37.519133 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 57/116] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:37 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:37.775259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f5b1faf8-6fe6-4f12-9602-fb95197f2736 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:37.776042 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f5b1faf8-6fe6-4f12-9602-fb95197f2736 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:37.788012 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5b1faf8-6fe6-4f12-9602-fb95197f2736 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:37.789474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5b1faf8-6fe6-4f12-9602-fb95197f2736 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:37.790572 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5b1faf8-6fe6-4f12-9602-fb95197f2736 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:37.792022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5b1faf8-6fe6-4f12-9602-fb95197f2736 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:37.792982 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5b1faf8-6fe6-4f12-9602-fb95197f2736 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:37.794844 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5b1faf8-6fe6-4f12-9602-fb95197f2736 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:37.948106 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-72b5183c-ce66-44cb-b491-6b8145458a19 req-ee0c6460-1aa8-4dcc-b9d6-55ab3b112f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db93852-3c79-43ac-8757-a41602e8bc53", "name": "network-vif-plugged", "status": "completed", "tag": "83aab753-4372-4b2f-a578-8ecea2f99be1"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:37.979099 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-72b5183c-ce66-44cb-b491-6b8145458a19 req-ee0c6460-1aa8-4dcc-b9d6-55ab3b112f9b service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:37.979099 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-72b5183c-ce66-44cb-b491-6b8145458a19 req-ee0c6460-1aa8-4dcc-b9d6-55ab3b112f9b service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:37.979099 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-72b5183c-ce66-44cb-b491-6b8145458a19 req-ee0c6460-1aa8-4dcc-b9d6-55ab3b112f9b service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:38.020063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-72b5183c-ce66-44cb-b491-6b8145458a19 req-ee0c6460-1aa8-4dcc-b9d6-55ab3b112f9b service nova] Creating event network-vif-plugged:83aab753-4372-4b2f-a578-8ecea2f99be1 for instance 3db93852-3c79-43ac-8757-a41602e8bc53 on hv-cinder-85426 Aug 29 20:33:38.021470 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-72b5183c-ce66-44cb-b491-6b8145458a19 req-ee0c6460-1aa8-4dcc-b9d6-55ab3b112f9b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127027) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 20:33:38.022215 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-72b5183c-ce66-44cb-b491-6b8145458a19 req-ee0c6460-1aa8-4dcc-b9d6-55ab3b112f9b service nova] Acquired lock "compute-rpcapi-router" {{(pid=127027) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 20:33:38.024260 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5eb1e06-ecb3-4361-bc8d-7e1f8a5b38b5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:38.027987 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5eb1e06-ecb3-4361-bc8d-7e1f8a5b38b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:38.029068 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5eb1e06-ecb3-4361-bc8d-7e1f8a5b38b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:38.031036 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5eb1e06-ecb3-4361-bc8d-7e1f8a5b38b5 None None] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:38.032140 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5eb1e06-ecb3-4361-bc8d-7e1f8a5b38b5 None None] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:38.032986 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5eb1e06-ecb3-4361-bc8d-7e1f8a5b38b5 None None] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:38.056104 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.compute.rpcapi [None req-c5eb1e06-ecb3-4361-bc8d-7e1f8a5b38b5 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 20:33:38.057957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5eb1e06-ecb3-4361-bc8d-7e1f8a5b38b5 None None] Releasing lock "compute-rpcapi-router" {{(pid=127027) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 20:33:38.090839 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c5eb1e06-ecb3-4361-bc8d-7e1f8a5b38b5 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262611 Aug 29 20:33:38.092230 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 58/117] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:38.328267 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f5b1faf8-6fe6-4f12-9602-fb95197f2736 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:38.349927 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f5b1faf8-6fe6-4f12-9602-fb95197f2736 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.579895 Aug 29 20:33:38.351829 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 60/118] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:37 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:38.422678 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8b4d07f2-774c-4da5-a5cd-02cda8467bdf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:38.424491 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8b4d07f2-774c-4da5-a5cd-02cda8467bdf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:38.432132 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8b4d07f2-774c-4da5-a5cd-02cda8467bdf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:38.432790 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8b4d07f2-774c-4da5-a5cd-02cda8467bdf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:38.433363 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8b4d07f2-774c-4da5-a5cd-02cda8467bdf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:38.434213 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8b4d07f2-774c-4da5-a5cd-02cda8467bdf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:38.434813 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8b4d07f2-774c-4da5-a5cd-02cda8467bdf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:38.435384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8b4d07f2-774c-4da5-a5cd-02cda8467bdf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:38.535382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1b3cc085-6077-4dc4-920f-585cc20ce55c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:38.536630 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1b3cc085-6077-4dc4-920f-585cc20ce55c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:38.543398 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b3cc085-6077-4dc4-920f-585cc20ce55c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:38.544650 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b3cc085-6077-4dc4-920f-585cc20ce55c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:38.545484 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b3cc085-6077-4dc4-920f-585cc20ce55c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:38.546331 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b3cc085-6077-4dc4-920f-585cc20ce55c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:38.547034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b3cc085-6077-4dc4-920f-585cc20ce55c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:38.547589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1b3cc085-6077-4dc4-920f-585cc20ce55c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:38.606842 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8b4d07f2-774c-4da5-a5cd-02cda8467bdf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:38.615090 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8b4d07f2-774c-4da5-a5cd-02cda8467bdf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.198424 Aug 29 20:33:38.615645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 59/119] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:38 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:38.708600 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1b3cc085-6077-4dc4-920f-585cc20ce55c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:38.718510 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1b3cc085-6077-4dc4-920f-585cc20ce55c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.187679 Aug 29 20:33:38.719277 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 61/120] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:38 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:39.370850 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9177c14f-9386-48c8-b788-5989e0e5ad7d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:39.371439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9177c14f-9386-48c8-b788-5989e0e5ad7d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:39.378915 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9177c14f-9386-48c8-b788-5989e0e5ad7d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:39.380010 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9177c14f-9386-48c8-b788-5989e0e5ad7d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:39.380542 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9177c14f-9386-48c8-b788-5989e0e5ad7d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:39.381448 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9177c14f-9386-48c8-b788-5989e0e5ad7d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:39.381972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9177c14f-9386-48c8-b788-5989e0e5ad7d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:39.382477 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9177c14f-9386-48c8-b788-5989e0e5ad7d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:39.571432 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9177c14f-9386-48c8-b788-5989e0e5ad7d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:39.582426 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9177c14f-9386-48c8-b788-5989e0e5ad7d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.215486 Aug 29 20:33:39.583594 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 60/121] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:39 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:39.647626 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a0067df3-6f82-4090-a0ff-ff58de3c9cbf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:39.648529 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a0067df3-6f82-4090-a0ff-ff58de3c9cbf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:39.655684 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0067df3-6f82-4090-a0ff-ff58de3c9cbf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:39.656369 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0067df3-6f82-4090-a0ff-ff58de3c9cbf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:39.657366 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0067df3-6f82-4090-a0ff-ff58de3c9cbf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:39.658300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0067df3-6f82-4090-a0ff-ff58de3c9cbf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:39.658761 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0067df3-6f82-4090-a0ff-ff58de3c9cbf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:39.659185 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a0067df3-6f82-4090-a0ff-ff58de3c9cbf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:39.745909 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-5515b484-890d-4667-b6b0-52a9b3961dbd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:39.748380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-5515b484-890d-4667-b6b0-52a9b3961dbd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:39.756204 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5515b484-890d-4667-b6b0-52a9b3961dbd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:39.756767 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5515b484-890d-4667-b6b0-52a9b3961dbd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:39.757564 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5515b484-890d-4667-b6b0-52a9b3961dbd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:39.758583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5515b484-890d-4667-b6b0-52a9b3961dbd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:39.759274 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5515b484-890d-4667-b6b0-52a9b3961dbd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:39.759879 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5515b484-890d-4667-b6b0-52a9b3961dbd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:39.814891 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a0067df3-6f82-4090-a0ff-ff58de3c9cbf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:39.822670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a0067df3-6f82-4090-a0ff-ff58de3c9cbf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.179652 Aug 29 20:33:39.823230 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 62/122] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:39 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:39.921464 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-5515b484-890d-4667-b6b0-52a9b3961dbd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:39.931094 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-5515b484-890d-4667-b6b0-52a9b3961dbd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.191715 Aug 29 20:33:39.932045 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 61/123] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:39 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:40.607076 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-74a891cf-9a33-462f-a9f0-72adf92c78da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:40.608247 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-74a891cf-9a33-462f-a9f0-72adf92c78da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:40.620320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74a891cf-9a33-462f-a9f0-72adf92c78da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:40.620320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74a891cf-9a33-462f-a9f0-72adf92c78da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:40.620320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74a891cf-9a33-462f-a9f0-72adf92c78da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:40.620320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74a891cf-9a33-462f-a9f0-72adf92c78da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:40.620647 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74a891cf-9a33-462f-a9f0-72adf92c78da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:40.620647 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-74a891cf-9a33-462f-a9f0-72adf92c78da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:40.647397 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:40.803423 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-74a891cf-9a33-462f-a9f0-72adf92c78da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:40.814766 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-74a891cf-9a33-462f-a9f0-72adf92c78da tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.214618 Aug 29 20:33:40.828731 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 63/124] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:40 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:40.844938 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-860ca097-f851-45bb-a6b4-451c6afc5e62 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:40.846301 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-860ca097-f851-45bb-a6b4-451c6afc5e62 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:40.857153 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-860ca097-f851-45bb-a6b4-451c6afc5e62 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:40.858523 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-860ca097-f851-45bb-a6b4-451c6afc5e62 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:40.859381 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-860ca097-f851-45bb-a6b4-451c6afc5e62 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:40.861383 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-860ca097-f851-45bb-a6b4-451c6afc5e62 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:40.863132 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-860ca097-f851-45bb-a6b4-451c6afc5e62 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:40.866058 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-860ca097-f851-45bb-a6b4-451c6afc5e62 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:40.964963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f1b557a7-efd4-447a-9d38-33068aca1221 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:40.966072 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f1b557a7-efd4-447a-9d38-33068aca1221 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:40.977003 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1b557a7-efd4-447a-9d38-33068aca1221 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:40.980578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1b557a7-efd4-447a-9d38-33068aca1221 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:40.981832 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1b557a7-efd4-447a-9d38-33068aca1221 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:40.983438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1b557a7-efd4-447a-9d38-33068aca1221 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:40.986281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1b557a7-efd4-447a-9d38-33068aca1221 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:40.987605 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1b557a7-efd4-447a-9d38-33068aca1221 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:41.099849 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-860ca097-f851-45bb-a6b4-451c6afc5e62 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:41.113675 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-860ca097-f851-45bb-a6b4-451c6afc5e62 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.270820 Aug 29 20:33:41.114952 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 62/125] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:40 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:41.433139 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f1b557a7-efd4-447a-9d38-33068aca1221 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:41.445436 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f1b557a7-efd4-447a-9d38-33068aca1221 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.486147 Aug 29 20:33:41.446373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 64/126] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:40 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:41.839334 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9368dc99-ac2d-4e98-ac4a-1aacff885937 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:41.840728 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9368dc99-ac2d-4e98-ac4a-1aacff885937 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:41.850978 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9368dc99-ac2d-4e98-ac4a-1aacff885937 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:41.852911 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9368dc99-ac2d-4e98-ac4a-1aacff885937 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:41.853986 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9368dc99-ac2d-4e98-ac4a-1aacff885937 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:41.856577 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9368dc99-ac2d-4e98-ac4a-1aacff885937 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:41.857787 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9368dc99-ac2d-4e98-ac4a-1aacff885937 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:41.858964 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9368dc99-ac2d-4e98-ac4a-1aacff885937 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:42.036886 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9368dc99-ac2d-4e98-ac4a-1aacff885937 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:42.046324 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9368dc99-ac2d-4e98-ac4a-1aacff885937 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.212711 Aug 29 20:33:42.047158 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 63/127] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:41 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:42.138920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-10f09abb-e889-42b7-8b08-3d5d1952dc52 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:42.139752 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-10f09abb-e889-42b7-8b08-3d5d1952dc52 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:42.146104 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10f09abb-e889-42b7-8b08-3d5d1952dc52 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:42.146678 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10f09abb-e889-42b7-8b08-3d5d1952dc52 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:42.147325 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10f09abb-e889-42b7-8b08-3d5d1952dc52 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:42.148228 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10f09abb-e889-42b7-8b08-3d5d1952dc52 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:42.148679 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10f09abb-e889-42b7-8b08-3d5d1952dc52 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:42.149103 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-10f09abb-e889-42b7-8b08-3d5d1952dc52 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:42.396912 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-10f09abb-e889-42b7-8b08-3d5d1952dc52 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:42.408294 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-10f09abb-e889-42b7-8b08-3d5d1952dc52 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.274021 Aug 29 20:33:42.409006 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 65/128] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:42 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:42.479006 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b5772116-058d-4841-a1b1-3b2677bfae82 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:42.480430 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b5772116-058d-4841-a1b1-3b2677bfae82 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:42.489216 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b5772116-058d-4841-a1b1-3b2677bfae82 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:42.490553 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b5772116-058d-4841-a1b1-3b2677bfae82 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:42.491255 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b5772116-058d-4841-a1b1-3b2677bfae82 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:42.492481 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b5772116-058d-4841-a1b1-3b2677bfae82 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:42.493136 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b5772116-058d-4841-a1b1-3b2677bfae82 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:42.493809 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b5772116-058d-4841-a1b1-3b2677bfae82 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:42.699395 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b5772116-058d-4841-a1b1-3b2677bfae82 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:42.710485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b5772116-058d-4841-a1b1-3b2677bfae82 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.236689 Aug 29 20:33:42.711130 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 64/129] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:42 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:43.069794 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-42e4a5a1-3275-49e9-b8b3-482b11f32dc9 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:43.070640 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-42e4a5a1-3275-49e9-b8b3-482b11f32dc9 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:43.077387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42e4a5a1-3275-49e9-b8b3-482b11f32dc9 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:43.078111 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42e4a5a1-3275-49e9-b8b3-482b11f32dc9 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:43.078547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42e4a5a1-3275-49e9-b8b3-482b11f32dc9 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:43.079249 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42e4a5a1-3275-49e9-b8b3-482b11f32dc9 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:43.079693 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42e4a5a1-3275-49e9-b8b3-482b11f32dc9 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:43.080224 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42e4a5a1-3275-49e9-b8b3-482b11f32dc9 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:43.256846 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-42e4a5a1-3275-49e9-b8b3-482b11f32dc9 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:43.266219 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-42e4a5a1-3275-49e9-b8b3-482b11f32dc9 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.201063 Aug 29 20:33:43.266813 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 66/130] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:43 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:43.437535 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-dcc9b7b9-7faa-45be-9b18-76a489b70fd7 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:43.438147 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-dcc9b7b9-7faa-45be-9b18-76a489b70fd7 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:43.444489 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-dcc9b7b9-7faa-45be-9b18-76a489b70fd7 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:43.444978 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-dcc9b7b9-7faa-45be-9b18-76a489b70fd7 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:43.445412 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-dcc9b7b9-7faa-45be-9b18-76a489b70fd7 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:43.446128 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-dcc9b7b9-7faa-45be-9b18-76a489b70fd7 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:43.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-dcc9b7b9-7faa-45be-9b18-76a489b70fd7 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:43.447275 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-dcc9b7b9-7faa-45be-9b18-76a489b70fd7 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:43.633431 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-dcc9b7b9-7faa-45be-9b18-76a489b70fd7 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:43.641768 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-dcc9b7b9-7faa-45be-9b18-76a489b70fd7 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.208001 Aug 29 20:33:43.642344 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 65/131] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:43 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:43.737671 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6b328571-0a82-4dcd-9fbf-763a9deff9d6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:43.738905 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6b328571-0a82-4dcd-9fbf-763a9deff9d6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:43.745920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b328571-0a82-4dcd-9fbf-763a9deff9d6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:43.746711 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b328571-0a82-4dcd-9fbf-763a9deff9d6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:43.747225 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b328571-0a82-4dcd-9fbf-763a9deff9d6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:43.748321 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b328571-0a82-4dcd-9fbf-763a9deff9d6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:43.749113 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b328571-0a82-4dcd-9fbf-763a9deff9d6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:43.749777 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6b328571-0a82-4dcd-9fbf-763a9deff9d6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:43.914025 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6b328571-0a82-4dcd-9fbf-763a9deff9d6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:43.922855 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6b328571-0a82-4dcd-9fbf-763a9deff9d6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.193273 Aug 29 20:33:43.925136 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 67/132] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:43 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:44.289625 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e4c9c60e-615c-45ea-abb6-97fd8d3cc1de tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:44.290800 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e4c9c60e-615c-45ea-abb6-97fd8d3cc1de tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:44.299160 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e4c9c60e-615c-45ea-abb6-97fd8d3cc1de tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:44.301564 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e4c9c60e-615c-45ea-abb6-97fd8d3cc1de tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:44.303120 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e4c9c60e-615c-45ea-abb6-97fd8d3cc1de tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:44.304503 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e4c9c60e-615c-45ea-abb6-97fd8d3cc1de tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:44.306454 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e4c9c60e-615c-45ea-abb6-97fd8d3cc1de tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:44.308001 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e4c9c60e-615c-45ea-abb6-97fd8d3cc1de tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:44.582564 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e4c9c60e-615c-45ea-abb6-97fd8d3cc1de tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:44.590883 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e4c9c60e-615c-45ea-abb6-97fd8d3cc1de tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.306157 Aug 29 20:33:44.591916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 66/133] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:44 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:44.668399 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b814acf1-e243-4bb3-a56c-1add30cb6cd8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:44.669501 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b814acf1-e243-4bb3-a56c-1add30cb6cd8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:44.678613 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b814acf1-e243-4bb3-a56c-1add30cb6cd8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:44.679348 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b814acf1-e243-4bb3-a56c-1add30cb6cd8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:44.680001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b814acf1-e243-4bb3-a56c-1add30cb6cd8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:44.680903 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b814acf1-e243-4bb3-a56c-1add30cb6cd8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:44.681552 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b814acf1-e243-4bb3-a56c-1add30cb6cd8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:44.682170 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b814acf1-e243-4bb3-a56c-1add30cb6cd8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:44.920589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-b814acf1-e243-4bb3-a56c-1add30cb6cd8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:44.931712 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b814acf1-e243-4bb3-a56c-1add30cb6cd8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.270449 Aug 29 20:33:44.932384 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 68/134] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:44 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:44.950511 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a6ad1de6-fe9d-4179-b884-3ba9b875fa79 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:44.951138 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a6ad1de6-fe9d-4179-b884-3ba9b875fa79 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:44.957439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a6ad1de6-fe9d-4179-b884-3ba9b875fa79 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:44.958743 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a6ad1de6-fe9d-4179-b884-3ba9b875fa79 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:44.959365 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a6ad1de6-fe9d-4179-b884-3ba9b875fa79 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:44.960111 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a6ad1de6-fe9d-4179-b884-3ba9b875fa79 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:44.960563 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a6ad1de6-fe9d-4179-b884-3ba9b875fa79 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:44.960981 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a6ad1de6-fe9d-4179-b884-3ba9b875fa79 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:45.301564 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a6ad1de6-fe9d-4179-b884-3ba9b875fa79 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:45.313042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a6ad1de6-fe9d-4179-b884-3ba9b875fa79 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.371438 Aug 29 20:33:45.313953 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 67/135] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:44 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:45.613245 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7aac7994-56c1-4e08-b1c0-621c095c41f7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:45.613825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7aac7994-56c1-4e08-b1c0-621c095c41f7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:45.620465 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7aac7994-56c1-4e08-b1c0-621c095c41f7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:45.620900 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7aac7994-56c1-4e08-b1c0-621c095c41f7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:45.621323 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7aac7994-56c1-4e08-b1c0-621c095c41f7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:45.622006 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7aac7994-56c1-4e08-b1c0-621c095c41f7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:45.622446 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7aac7994-56c1-4e08-b1c0-621c095c41f7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:45.622854 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7aac7994-56c1-4e08-b1c0-621c095c41f7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:45.770006 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7aac7994-56c1-4e08-b1c0-621c095c41f7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:45.778558 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7aac7994-56c1-4e08-b1c0-621c095c41f7 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.169068 Aug 29 20:33:45.779193 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 69/136] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:45 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:45.953892 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-38ca7451-9599-4f4f-a4b6-060e23f187c4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:45.954534 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-38ca7451-9599-4f4f-a4b6-060e23f187c4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:45.961007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-38ca7451-9599-4f4f-a4b6-060e23f187c4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:45.961765 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-38ca7451-9599-4f4f-a4b6-060e23f187c4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:45.962367 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-38ca7451-9599-4f4f-a4b6-060e23f187c4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:45.963065 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-38ca7451-9599-4f4f-a4b6-060e23f187c4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:45.963508 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-38ca7451-9599-4f4f-a4b6-060e23f187c4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:45.963921 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-38ca7451-9599-4f4f-a4b6-060e23f187c4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:46.123334 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-38ca7451-9599-4f4f-a4b6-060e23f187c4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:46.132920 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-38ca7451-9599-4f4f-a4b6-060e23f187c4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.182681 Aug 29 20:33:46.133783 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 68/137] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:45 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:46.338178 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-56162e43-23d6-4688-b961-4ac90c9ba55e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:46.338781 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-56162e43-23d6-4688-b961-4ac90c9ba55e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:46.345189 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56162e43-23d6-4688-b961-4ac90c9ba55e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:46.345678 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56162e43-23d6-4688-b961-4ac90c9ba55e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:46.346106 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56162e43-23d6-4688-b961-4ac90c9ba55e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:46.346801 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56162e43-23d6-4688-b961-4ac90c9ba55e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:46.347246 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56162e43-23d6-4688-b961-4ac90c9ba55e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:46.347660 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-56162e43-23d6-4688-b961-4ac90c9ba55e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:46.493819 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-56162e43-23d6-4688-b961-4ac90c9ba55e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:46.502037 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-56162e43-23d6-4688-b961-4ac90c9ba55e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.167658 Aug 29 20:33:46.503284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 70/138] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:46 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:46.800061 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-61262a16-2406-48a9-b8d9-0f845187ed16 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:46.800681 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-61262a16-2406-48a9-b8d9-0f845187ed16 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:46.807104 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61262a16-2406-48a9-b8d9-0f845187ed16 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:46.807605 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61262a16-2406-48a9-b8d9-0f845187ed16 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:46.808039 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61262a16-2406-48a9-b8d9-0f845187ed16 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:46.808743 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61262a16-2406-48a9-b8d9-0f845187ed16 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:46.809195 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61262a16-2406-48a9-b8d9-0f845187ed16 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:46.809612 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61262a16-2406-48a9-b8d9-0f845187ed16 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:46.954893 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-61262a16-2406-48a9-b8d9-0f845187ed16 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:46.963922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-61262a16-2406-48a9-b8d9-0f845187ed16 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.167754 Aug 29 20:33:46.964995 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 69/139] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:46 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:47.155474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-520bfee5-dd51-43ba-8b9f-2e6887179078 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:47.156736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-520bfee5-dd51-43ba-8b9f-2e6887179078 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:47.163298 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-520bfee5-dd51-43ba-8b9f-2e6887179078 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:47.163819 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-520bfee5-dd51-43ba-8b9f-2e6887179078 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:47.164334 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-520bfee5-dd51-43ba-8b9f-2e6887179078 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:47.165028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-520bfee5-dd51-43ba-8b9f-2e6887179078 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:47.165621 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-520bfee5-dd51-43ba-8b9f-2e6887179078 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:47.166187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-520bfee5-dd51-43ba-8b9f-2e6887179078 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:47.313816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-520bfee5-dd51-43ba-8b9f-2e6887179078 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:47.322276 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-520bfee5-dd51-43ba-8b9f-2e6887179078 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.170510 Aug 29 20:33:47.322868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 71/140] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:47 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:47.523064 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-72c0eb14-a015-4630-a970-5cd3cba9c5fd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:47.523666 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-72c0eb14-a015-4630-a970-5cd3cba9c5fd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:47.530063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-72c0eb14-a015-4630-a970-5cd3cba9c5fd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:47.530554 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-72c0eb14-a015-4630-a970-5cd3cba9c5fd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:47.530986 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-72c0eb14-a015-4630-a970-5cd3cba9c5fd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:47.531684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-72c0eb14-a015-4630-a970-5cd3cba9c5fd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:47.532172 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-72c0eb14-a015-4630-a970-5cd3cba9c5fd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:47.532587 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-72c0eb14-a015-4630-a970-5cd3cba9c5fd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:47.665859 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-72c0eb14-a015-4630-a970-5cd3cba9c5fd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:47.676195 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-72c0eb14-a015-4630-a970-5cd3cba9c5fd tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.155871 Aug 29 20:33:47.676195 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 70/141] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:47 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:47.989647 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cd880976-6efb-48e7-ab9a-2be8b7273886 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:47.990310 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cd880976-6efb-48e7-ab9a-2be8b7273886 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:47.996895 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd880976-6efb-48e7-ab9a-2be8b7273886 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:47.997372 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd880976-6efb-48e7-ab9a-2be8b7273886 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:47.997851 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd880976-6efb-48e7-ab9a-2be8b7273886 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:47.998545 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd880976-6efb-48e7-ab9a-2be8b7273886 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:47.998951 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd880976-6efb-48e7-ab9a-2be8b7273886 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:47.999431 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd880976-6efb-48e7-ab9a-2be8b7273886 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:48.148348 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-cd880976-6efb-48e7-ab9a-2be8b7273886 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:48.156491 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cd880976-6efb-48e7-ab9a-2be8b7273886 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.170962 Aug 29 20:33:48.157161 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 72/142] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:47 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:48.183357 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-4ae69570-e8a4-47ab-876b-7baf829c4bd5 req-4c3fc206-69e1-41d1-9ced-bb4728e676cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150aa4a3-390c-4eb1-91ea-236f55e59e57", "name": "network-vif-plugged", "status": "completed", "tag": "2cdd540d-17e7-4430-81b9-58cbfc6bfafc"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:48.188930 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:48.195346 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-4ae69570-e8a4-47ab-876b-7baf829c4bd5 req-4c3fc206-69e1-41d1-9ced-bb4728e676cb service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:48.195826 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-4ae69570-e8a4-47ab-876b-7baf829c4bd5 req-4c3fc206-69e1-41d1-9ced-bb4728e676cb service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:48.196283 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-4ae69570-e8a4-47ab-876b-7baf829c4bd5 req-4c3fc206-69e1-41d1-9ced-bb4728e676cb service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:48.211116 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-4ae69570-e8a4-47ab-876b-7baf829c4bd5 req-4c3fc206-69e1-41d1-9ced-bb4728e676cb service nova] Creating event network-vif-plugged:2cdd540d-17e7-4430-81b9-58cbfc6bfafc for instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 on hv-cinder-85426 Aug 29 20:33:48.220340 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-4ae69570-e8a4-47ab-876b-7baf829c4bd5 req-4c3fc206-69e1-41d1-9ced-bb4728e676cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040877 Aug 29 20:33:48.221548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 71/143] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:48.343048 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0a8ff879-fa46-406e-8607-f01089b3f9ad tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:48.344027 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0a8ff879-fa46-406e-8607-f01089b3f9ad tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:48.352323 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a8ff879-fa46-406e-8607-f01089b3f9ad tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:48.353325 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a8ff879-fa46-406e-8607-f01089b3f9ad tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:48.354179 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a8ff879-fa46-406e-8607-f01089b3f9ad tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:48.355299 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a8ff879-fa46-406e-8607-f01089b3f9ad tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:48.360605 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a8ff879-fa46-406e-8607-f01089b3f9ad tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:48.360605 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a8ff879-fa46-406e-8607-f01089b3f9ad tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:48.658211 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0a8ff879-fa46-406e-8607-f01089b3f9ad tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:48.666566 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0a8ff879-fa46-406e-8607-f01089b3f9ad tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.327488 Aug 29 20:33:48.680861 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 73/144] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:48 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:48.697805 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-da800935-2b78-4d48-8dad-d7611f7a5596 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:48.698658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-da800935-2b78-4d48-8dad-d7611f7a5596 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:48.708525 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da800935-2b78-4d48-8dad-d7611f7a5596 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:48.708525 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da800935-2b78-4d48-8dad-d7611f7a5596 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:48.708525 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da800935-2b78-4d48-8dad-d7611f7a5596 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:48.708525 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da800935-2b78-4d48-8dad-d7611f7a5596 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:48.709322 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da800935-2b78-4d48-8dad-d7611f7a5596 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:48.709322 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da800935-2b78-4d48-8dad-d7611f7a5596 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:48.908207 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-da800935-2b78-4d48-8dad-d7611f7a5596 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:48.920120 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=100 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:48.927204 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-da800935-2b78-4d48-8dad-d7611f7a5596 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.236042 Aug 29 20:33:48.928994 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 72/145] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:48 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:49.182738 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-88a3bc5e-043a-4b78-a9aa-ad067865b7b6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:49.184638 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-88a3bc5e-043a-4b78-a9aa-ad067865b7b6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:49.205140 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88a3bc5e-043a-4b78-a9aa-ad067865b7b6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:49.214447 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88a3bc5e-043a-4b78-a9aa-ad067865b7b6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:49.215220 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88a3bc5e-043a-4b78-a9aa-ad067865b7b6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:49.217203 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88a3bc5e-043a-4b78-a9aa-ad067865b7b6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:49.220562 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88a3bc5e-043a-4b78-a9aa-ad067865b7b6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:49.224020 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-88a3bc5e-043a-4b78-a9aa-ad067865b7b6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:49.558940 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-88a3bc5e-043a-4b78-a9aa-ad067865b7b6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:49.567660 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-88a3bc5e-043a-4b78-a9aa-ad067865b7b6 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.392019 Aug 29 20:33:49.572290 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 74/146] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:49 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:49.689478 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-abf27ab6-4a46-4525-bb6d-18af05c1357c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:49.690224 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-abf27ab6-4a46-4525-bb6d-18af05c1357c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:49.702040 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-abf27ab6-4a46-4525-bb6d-18af05c1357c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:49.702557 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-abf27ab6-4a46-4525-bb6d-18af05c1357c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:49.704076 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-abf27ab6-4a46-4525-bb6d-18af05c1357c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:49.704815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-abf27ab6-4a46-4525-bb6d-18af05c1357c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:49.705918 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-abf27ab6-4a46-4525-bb6d-18af05c1357c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:49.707246 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-abf27ab6-4a46-4525-bb6d-18af05c1357c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:49.951647 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-abf27ab6-4a46-4525-bb6d-18af05c1357c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:49.955243 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13609eaa-4790-4945-b625-e5a76ac96451 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:49.958160 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-13609eaa-4790-4945-b625-e5a76ac96451 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:49.967567 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-abf27ab6-4a46-4525-bb6d-18af05c1357c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.282961 Aug 29 20:33:49.971360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 73/147] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:49 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:49.972231 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13609eaa-4790-4945-b625-e5a76ac96451 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:49.973216 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13609eaa-4790-4945-b625-e5a76ac96451 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:49.973853 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13609eaa-4790-4945-b625-e5a76ac96451 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:49.975310 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13609eaa-4790-4945-b625-e5a76ac96451 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:49.975964 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13609eaa-4790-4945-b625-e5a76ac96451 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:49.976570 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13609eaa-4790-4945-b625-e5a76ac96451 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:50.301677 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-13609eaa-4790-4945-b625-e5a76ac96451 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:50.318010 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-13609eaa-4790-4945-b625-e5a76ac96451 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.369579 Aug 29 20:33:50.320721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 75/148] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:49 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:50.565663 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-92000f19-73ef-4c8b-a2c6-5f61699c0da4 req-36447c6e-e9d9-4e50-bc8a-bc938f31c28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc0cdac-77c6-4130-b162-e04f6a61c60c", "name": "network-vif-plugged", "status": "completed", "tag": "d8d1277a-533e-438a-99e5-6a4962cfe90d"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:50.571348 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=73 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:50.585935 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-92000f19-73ef-4c8b-a2c6-5f61699c0da4 req-36447c6e-e9d9-4e50-bc8a-bc938f31c28f service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:50.588538 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-92000f19-73ef-4c8b-a2c6-5f61699c0da4 req-36447c6e-e9d9-4e50-bc8a-bc938f31c28f service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:50.588980 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-92000f19-73ef-4c8b-a2c6-5f61699c0da4 req-36447c6e-e9d9-4e50-bc8a-bc938f31c28f service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:50.601847 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-25afb098-fd2a-4de8-9b89-a5e3318e0507 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:50.602830 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-25afb098-fd2a-4de8-9b89-a5e3318e0507 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:50.619340 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25afb098-fd2a-4de8-9b89-a5e3318e0507 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:50.620742 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25afb098-fd2a-4de8-9b89-a5e3318e0507 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:50.622145 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-92000f19-73ef-4c8b-a2c6-5f61699c0da4 req-36447c6e-e9d9-4e50-bc8a-bc938f31c28f service nova] Creating event network-vif-plugged:d8d1277a-533e-438a-99e5-6a4962cfe90d for instance 5dc0cdac-77c6-4130-b162-e04f6a61c60c on hv-cinder-85426 Aug 29 20:33:50.628112 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25afb098-fd2a-4de8-9b89-a5e3318e0507 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:50.628340 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-92000f19-73ef-4c8b-a2c6-5f61699c0da4 req-36447c6e-e9d9-4e50-bc8a-bc938f31c28f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066075 Aug 29 20:33:50.628943 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25afb098-fd2a-4de8-9b89-a5e3318e0507 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:50.629580 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 74/149] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:50.630138 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25afb098-fd2a-4de8-9b89-a5e3318e0507 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:50.631710 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25afb098-fd2a-4de8-9b89-a5e3318e0507 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:50.996671 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-196aa9d1-1dab-496a-9c18-d9039e538ac6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:50.997413 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-196aa9d1-1dab-496a-9c18-d9039e538ac6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:51.017915 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-196aa9d1-1dab-496a-9c18-d9039e538ac6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:51.019106 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-196aa9d1-1dab-496a-9c18-d9039e538ac6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:51.023402 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-196aa9d1-1dab-496a-9c18-d9039e538ac6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:51.024456 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-196aa9d1-1dab-496a-9c18-d9039e538ac6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:51.025030 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-196aa9d1-1dab-496a-9c18-d9039e538ac6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:51.028486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-196aa9d1-1dab-496a-9c18-d9039e538ac6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:51.059865 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-25afb098-fd2a-4de8-9b89-a5e3318e0507 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:51.079065 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-25afb098-fd2a-4de8-9b89-a5e3318e0507 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1315 microversion: 2.1 time: 0.493024 Aug 29 20:33:51.081289 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 76/150] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:50 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:51.336082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-196aa9d1-1dab-496a-9c18-d9039e538ac6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:51.342526 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-14f13add-097a-4bfa-8c7b-d9968e2808a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:51.343212 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-14f13add-097a-4bfa-8c7b-d9968e2808a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:51.345551 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-196aa9d1-1dab-496a-9c18-d9039e538ac6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.355998 Aug 29 20:33:51.347801 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 75/151] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:50 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:51.371336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14f13add-097a-4bfa-8c7b-d9968e2808a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:51.371848 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14f13add-097a-4bfa-8c7b-d9968e2808a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:51.374674 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14f13add-097a-4bfa-8c7b-d9968e2808a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:51.376647 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14f13add-097a-4bfa-8c7b-d9968e2808a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:51.377133 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14f13add-097a-4bfa-8c7b-d9968e2808a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:51.378793 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14f13add-097a-4bfa-8c7b-d9968e2808a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:51.600443 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-14f13add-097a-4bfa-8c7b-d9968e2808a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:51.609739 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-14f13add-097a-4bfa-8c7b-d9968e2808a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.272458 Aug 29 20:33:51.610800 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 77/152] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:51 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:52.105485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-80d03146-897b-4eef-9fbb-ab9d102655a1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:52.106347 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-80d03146-897b-4eef-9fbb-ab9d102655a1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:52.114581 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80d03146-897b-4eef-9fbb-ab9d102655a1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:52.115414 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80d03146-897b-4eef-9fbb-ab9d102655a1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:52.116476 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80d03146-897b-4eef-9fbb-ab9d102655a1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:52.117505 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80d03146-897b-4eef-9fbb-ab9d102655a1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:52.118444 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80d03146-897b-4eef-9fbb-ab9d102655a1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:52.119016 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80d03146-897b-4eef-9fbb-ab9d102655a1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:52.291661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-80d03146-897b-4eef-9fbb-ab9d102655a1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:52.304813 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-80d03146-897b-4eef-9fbb-ab9d102655a1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1502 microversion: 2.1 time: 0.206315 Aug 29 20:33:52.319859 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 76/153] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:52 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:52.372018 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-64dc0f41-be57-4ff8-a1aa-b3dd21197d7d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:52.373346 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-64dc0f41-be57-4ff8-a1aa-b3dd21197d7d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:52.383430 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64dc0f41-be57-4ff8-a1aa-b3dd21197d7d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:52.384229 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64dc0f41-be57-4ff8-a1aa-b3dd21197d7d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:52.384682 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64dc0f41-be57-4ff8-a1aa-b3dd21197d7d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:52.385504 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64dc0f41-be57-4ff8-a1aa-b3dd21197d7d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:52.389707 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64dc0f41-be57-4ff8-a1aa-b3dd21197d7d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:52.390117 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-64dc0f41-be57-4ff8-a1aa-b3dd21197d7d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:52.594886 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-64dc0f41-be57-4ff8-a1aa-b3dd21197d7d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:52.604893 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-64dc0f41-be57-4ff8-a1aa-b3dd21197d7d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.237268 Aug 29 20:33:52.605866 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 78/154] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:52 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:52.633744 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6d8bf16d-e293-4f20-bd48-a9933d41f9de tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:52.634709 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6d8bf16d-e293-4f20-bd48-a9933d41f9de tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:52.642185 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6d8bf16d-e293-4f20-bd48-a9933d41f9de tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:52.643668 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6d8bf16d-e293-4f20-bd48-a9933d41f9de tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:52.644376 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6d8bf16d-e293-4f20-bd48-a9933d41f9de tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:52.645911 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6d8bf16d-e293-4f20-bd48-a9933d41f9de tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:52.646636 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6d8bf16d-e293-4f20-bd48-a9933d41f9de tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:52.647245 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6d8bf16d-e293-4f20-bd48-a9933d41f9de tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:52.701729 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ac971f8d-20e9-43e0-ab57-870570c6d2da req-167ab86c-8f83-415e-97ee-aa73484c3746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfdda123-bbf1-425b-b690-2d0919df08a2", "name": "network-vif-plugged", "status": "completed", "tag": "98948443-f8c1-415f-85ca-da7736524db5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:52.715443 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ac971f8d-20e9-43e0-ab57-870570c6d2da req-167ab86c-8f83-415e-97ee-aa73484c3746 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:52.716248 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ac971f8d-20e9-43e0-ab57-870570c6d2da req-167ab86c-8f83-415e-97ee-aa73484c3746 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:52.717084 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ac971f8d-20e9-43e0-ab57-870570c6d2da req-167ab86c-8f83-415e-97ee-aa73484c3746 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:52.775924 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ac971f8d-20e9-43e0-ab57-870570c6d2da req-167ab86c-8f83-415e-97ee-aa73484c3746 service nova] Creating event network-vif-plugged:98948443-f8c1-415f-85ca-da7736524db5 for instance dfdda123-bbf1-425b-b690-2d0919df08a2 on hv-cinder-85426 Aug 29 20:33:52.811753 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ac971f8d-20e9-43e0-ab57-870570c6d2da req-167ab86c-8f83-415e-97ee-aa73484c3746 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114287 Aug 29 20:33:52.812881 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 79/155] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:33:52.840541 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-6d8bf16d-e293-4f20-bd48-a9933d41f9de tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:52.850008 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6d8bf16d-e293-4f20-bd48-a9933d41f9de tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1322 microversion: 2.1 time: 0.222720 Aug 29 20:33:52.851336 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 77/156] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:52 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:53.629175 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-205bef47-0be3-4a44-9e9e-fd4f5331751d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:53.630585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-205bef47-0be3-4a44-9e9e-fd4f5331751d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:53.647526 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-205bef47-0be3-4a44-9e9e-fd4f5331751d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:53.649004 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-205bef47-0be3-4a44-9e9e-fd4f5331751d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:53.649861 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-205bef47-0be3-4a44-9e9e-fd4f5331751d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:53.651163 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-205bef47-0be3-4a44-9e9e-fd4f5331751d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:53.652080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-205bef47-0be3-4a44-9e9e-fd4f5331751d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:53.652729 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-205bef47-0be3-4a44-9e9e-fd4f5331751d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:53.871023 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-0f81763d-18eb-4baf-8edb-d396a8031858 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:53.885536 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-0f81763d-18eb-4baf-8edb-d396a8031858 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:53.894373 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0f81763d-18eb-4baf-8edb-d396a8031858 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:53.895443 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0f81763d-18eb-4baf-8edb-d396a8031858 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:53.896108 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0f81763d-18eb-4baf-8edb-d396a8031858 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:53.897185 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0f81763d-18eb-4baf-8edb-d396a8031858 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:53.897824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0f81763d-18eb-4baf-8edb-d396a8031858 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:53.898478 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0f81763d-18eb-4baf-8edb-d396a8031858 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:54.050149 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-205bef47-0be3-4a44-9e9e-fd4f5331751d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:54.054481 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:54.061198 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-205bef47-0be3-4a44-9e9e-fd4f5331751d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.438256 Aug 29 20:33:54.062108 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 80/157] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:53 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:54.111386 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-0f81763d-18eb-4baf-8edb-d396a8031858 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:54.122329 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-0f81763d-18eb-4baf-8edb-d396a8031858 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1516 microversion: 2.1 time: 0.255215 Aug 29 20:33:54.125805 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 78/158] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:53 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1516 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:33:54.168602 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5846c4b0-efca-45e2-9feb-ad3fad52f3fa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:54.173018 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5846c4b0-efca-45e2-9feb-ad3fad52f3fa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:54.185501 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5846c4b0-efca-45e2-9feb-ad3fad52f3fa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:54.186916 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5846c4b0-efca-45e2-9feb-ad3fad52f3fa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:54.187861 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5846c4b0-efca-45e2-9feb-ad3fad52f3fa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:54.189636 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5846c4b0-efca-45e2-9feb-ad3fad52f3fa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:54.191004 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5846c4b0-efca-45e2-9feb-ad3fad52f3fa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:54.192103 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5846c4b0-efca-45e2-9feb-ad3fad52f3fa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:54.216784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a2bd39ee-b5bc-4b51-a687-945ceb717127 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cece4795-d292-40ec-a2f8-b130d615be6d"}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:54.232959 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a2bd39ee-b5bc-4b51-a687-945ceb717127 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:54.245206 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a2bd39ee-b5bc-4b51-a687-945ceb717127 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:54.245738 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a2bd39ee-b5bc-4b51-a687-945ceb717127 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:54.249138 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a2bd39ee-b5bc-4b51-a687-945ceb717127 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:54.251085 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a2bd39ee-b5bc-4b51-a687-945ceb717127 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:54.252583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a2bd39ee-b5bc-4b51-a687-945ceb717127 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:54.253023 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a2bd39ee-b5bc-4b51-a687-945ceb717127 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:54.337143 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-5846c4b0-efca-45e2-9feb-ad3fad52f3fa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lazy-loading 'flavor' on Instance uuid 5dc0cdac-77c6-4130-b162-e04f6a61c60c {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:33:54.711877 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5846c4b0-efca-45e2-9feb-ad3fad52f3fa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "POST /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c/action" status: 200 len: 32 microversion: 2.1 time: 0.557930 Aug 29 20:33:54.713107 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 81/159] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 29 20:33:54 2022] POST /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c/action => generated 32 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:33:54.726913 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-37e24fae-4497-4a08-8d94-67021fc78e1e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:54.728287 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-37e24fae-4497-4a08-8d94-67021fc78e1e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:54.737271 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e24fae-4497-4a08-8d94-67021fc78e1e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:54.737754 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e24fae-4497-4a08-8d94-67021fc78e1e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:54.738185 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e24fae-4497-4a08-8d94-67021fc78e1e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:54.740018 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e24fae-4497-4a08-8d94-67021fc78e1e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:54.740658 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e24fae-4497-4a08-8d94-67021fc78e1e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:54.741859 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e24fae-4497-4a08-8d94-67021fc78e1e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:55.170407 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a2bd39ee-b5bc-4b51-a687-945ceb717127 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "POST /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.959035 Aug 29 20:33:55.171780 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 79/160] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 29 20:33:54 2022] POST /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57/os-volume_attachments => generated 194 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:55.185978 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-516b0b53-9721-402f-839b-9e937c399242 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:55.186853 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-516b0b53-9721-402f-839b-9e937c399242 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:55.199181 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-516b0b53-9721-402f-839b-9e937c399242 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:55.200256 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-516b0b53-9721-402f-839b-9e937c399242 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:55.200956 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-516b0b53-9721-402f-839b-9e937c399242 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:55.201982 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-516b0b53-9721-402f-839b-9e937c399242 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:55.202892 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-516b0b53-9721-402f-839b-9e937c399242 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:55.203870 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-516b0b53-9721-402f-839b-9e937c399242 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:55.233608 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-37e24fae-4497-4a08-8d94-67021fc78e1e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:55.249291 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-37e24fae-4497-4a08-8d94-67021fc78e1e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.529239 Aug 29 20:33:55.253055 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 82/161] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:54 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:55.488809 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-516b0b53-9721-402f-839b-9e937c399242 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:55.498924 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-516b0b53-9721-402f-839b-9e937c399242 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1362 microversion: 2.1 time: 0.321153 Aug 29 20:33:55.514478 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 80/162] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:55 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:56.273531 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7490266a-9f30-4c7c-bbb6-0ffaf16d83bc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:56.274149 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7490266a-9f30-4c7c-bbb6-0ffaf16d83bc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:56.280448 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7490266a-9f30-4c7c-bbb6-0ffaf16d83bc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:56.280881 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7490266a-9f30-4c7c-bbb6-0ffaf16d83bc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:56.281316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7490266a-9f30-4c7c-bbb6-0ffaf16d83bc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:56.282014 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7490266a-9f30-4c7c-bbb6-0ffaf16d83bc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:56.282471 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7490266a-9f30-4c7c-bbb6-0ffaf16d83bc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:56.282900 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7490266a-9f30-4c7c-bbb6-0ffaf16d83bc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:56.429077 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7490266a-9f30-4c7c-bbb6-0ffaf16d83bc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:56.439126 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7490266a-9f30-4c7c-bbb6-0ffaf16d83bc tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.168853 Aug 29 20:33:56.439733 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 83/163] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:56 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:56.526537 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6c8b2602-2422-4dfc-a08a-796259aaacfb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:56.527277 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6c8b2602-2422-4dfc-a08a-796259aaacfb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:56.534122 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c8b2602-2422-4dfc-a08a-796259aaacfb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:56.534858 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c8b2602-2422-4dfc-a08a-796259aaacfb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:56.535280 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c8b2602-2422-4dfc-a08a-796259aaacfb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:56.536226 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c8b2602-2422-4dfc-a08a-796259aaacfb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:56.536778 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c8b2602-2422-4dfc-a08a-796259aaacfb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:56.537212 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c8b2602-2422-4dfc-a08a-796259aaacfb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:56.696074 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-6c8b2602-2422-4dfc-a08a-796259aaacfb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:56.705211 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6c8b2602-2422-4dfc-a08a-796259aaacfb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1549 microversion: 2.1 time: 0.182434 Aug 29 20:33:56.706712 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 81/164] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:56 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1549 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:56.732192 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1bc373c8-052b-4382-8569-095f7ca4bf73 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:56.732812 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1bc373c8-052b-4382-8569-095f7ca4bf73 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:56.744855 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bc373c8-052b-4382-8569-095f7ca4bf73 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:56.744855 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bc373c8-052b-4382-8569-095f7ca4bf73 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:56.744855 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bc373c8-052b-4382-8569-095f7ca4bf73 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:56.744855 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bc373c8-052b-4382-8569-095f7ca4bf73 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:56.745588 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bc373c8-052b-4382-8569-095f7ca4bf73 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:56.745588 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1bc373c8-052b-4382-8569-095f7ca4bf73 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:56.840958 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1bc373c8-052b-4382-8569-095f7ca4bf73 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113452 Aug 29 20:33:56.840958 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 84/165] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 29 20:33:56 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:57.470602 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-097be845-8216-4d06-8453-a3a1d5ca7ed5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:57.471222 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-097be845-8216-4d06-8453-a3a1d5ca7ed5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:57.486654 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-097be845-8216-4d06-8453-a3a1d5ca7ed5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:57.487760 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-097be845-8216-4d06-8453-a3a1d5ca7ed5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:57.490242 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-097be845-8216-4d06-8453-a3a1d5ca7ed5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:57.493167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-097be845-8216-4d06-8453-a3a1d5ca7ed5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:57.493859 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-097be845-8216-4d06-8453-a3a1d5ca7ed5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:57.494671 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-097be845-8216-4d06-8453-a3a1d5ca7ed5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:57.843959 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-097be845-8216-4d06-8453-a3a1d5ca7ed5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:57.855602 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-097be845-8216-4d06-8453-a3a1d5ca7ed5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.388857 Aug 29 20:33:57.859439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 82/166] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:57 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:33:58.730790 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c6f87584-94c5-4676-9d9a-7daa1b9ec178 req-115a8097-8866-4a5f-bf3b-c48df0f9ab21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdda123-bbf1-425b-b690-2d0919df08a2", "tag": "98948443-f8c1-415f-85ca-da7736524db5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:33:58.770598 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=66 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:58.790381 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c6f87584-94c5-4676-9d9a-7daa1b9ec178 req-115a8097-8866-4a5f-bf3b-c48df0f9ab21 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:58.790917 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c6f87584-94c5-4676-9d9a-7daa1b9ec178 req-115a8097-8866-4a5f-bf3b-c48df0f9ab21 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:58.791349 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c6f87584-94c5-4676-9d9a-7daa1b9ec178 req-115a8097-8866-4a5f-bf3b-c48df0f9ab21 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:58.834711 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c6f87584-94c5-4676-9d9a-7daa1b9ec178 req-115a8097-8866-4a5f-bf3b-c48df0f9ab21 service nova] Creating event network-changed:98948443-f8c1-415f-85ca-da7736524db5 for instance dfdda123-bbf1-425b-b690-2d0919df08a2 on hv-cinder-85426 Aug 29 20:33:58.843771 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c6f87584-94c5-4676-9d9a-7daa1b9ec178 req-115a8097-8866-4a5f-bf3b-c48df0f9ab21 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117693 Aug 29 20:33:58.844670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 85/167] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:33:58.885321 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d124bc21-b8c1-4bd4-8779-b91859f956f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:33:58.887117 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d124bc21-b8c1-4bd4-8779-b91859f956f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:33:58.902043 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d124bc21-b8c1-4bd4-8779-b91859f956f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:58.905267 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d124bc21-b8c1-4bd4-8779-b91859f956f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:58.907324 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d124bc21-b8c1-4bd4-8779-b91859f956f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:58.911841 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d124bc21-b8c1-4bd4-8779-b91859f956f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:33:58.914400 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d124bc21-b8c1-4bd4-8779-b91859f956f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:33:58.915603 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d124bc21-b8c1-4bd4-8779-b91859f956f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:33:59.160215 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d124bc21-b8c1-4bd4-8779-b91859f956f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:33:59.173600 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d124bc21-b8c1-4bd4-8779-b91859f956f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.294623 Aug 29 20:33:59.174644 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 83/168] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:33:58 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:00.197300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-476be829-955c-4d90-bd87-8ee1db8d90af tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:00.198006 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-476be829-955c-4d90-bd87-8ee1db8d90af tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:00.205748 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-476be829-955c-4d90-bd87-8ee1db8d90af tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:00.206238 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-476be829-955c-4d90-bd87-8ee1db8d90af tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:00.206671 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-476be829-955c-4d90-bd87-8ee1db8d90af tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:00.207969 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-476be829-955c-4d90-bd87-8ee1db8d90af tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:00.208457 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-476be829-955c-4d90-bd87-8ee1db8d90af tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:00.208909 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-476be829-955c-4d90-bd87-8ee1db8d90af tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:00.542827 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-476be829-955c-4d90-bd87-8ee1db8d90af tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:00.561725 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-476be829-955c-4d90-bd87-8ee1db8d90af tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.370497 Aug 29 20:34:00.562785 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 86/169] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:00 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:01.583775 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-352a1a53-cedc-44e7-96aa-b99336d6fc47 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:01.584566 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-352a1a53-cedc-44e7-96aa-b99336d6fc47 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:01.599109 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-352a1a53-cedc-44e7-96aa-b99336d6fc47 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:01.600182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-352a1a53-cedc-44e7-96aa-b99336d6fc47 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:01.606760 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-352a1a53-cedc-44e7-96aa-b99336d6fc47 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:01.608743 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-352a1a53-cedc-44e7-96aa-b99336d6fc47 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:01.609439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-352a1a53-cedc-44e7-96aa-b99336d6fc47 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:01.610154 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-352a1a53-cedc-44e7-96aa-b99336d6fc47 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:01.820500 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-352a1a53-cedc-44e7-96aa-b99336d6fc47 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:01.830142 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-352a1a53-cedc-44e7-96aa-b99336d6fc47 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.249862 Aug 29 20:34:01.830765 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 84/170] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:01 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:02.852945 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dee9e22c-635c-43a7-972e-733d3e788cc1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:02.853546 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dee9e22c-635c-43a7-972e-733d3e788cc1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:02.859677 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dee9e22c-635c-43a7-972e-733d3e788cc1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:02.860283 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dee9e22c-635c-43a7-972e-733d3e788cc1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:02.860715 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dee9e22c-635c-43a7-972e-733d3e788cc1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:02.861425 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dee9e22c-635c-43a7-972e-733d3e788cc1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:02.861878 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dee9e22c-635c-43a7-972e-733d3e788cc1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:02.862294 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dee9e22c-635c-43a7-972e-733d3e788cc1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:03.095668 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-dee9e22c-635c-43a7-972e-733d3e788cc1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:03.110462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dee9e22c-635c-43a7-972e-733d3e788cc1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.261422 Aug 29 20:34:03.111172 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 87/171] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:02 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:04.138601 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b69e7872-0c0a-4087-9362-914745e84486 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:04.139215 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b69e7872-0c0a-4087-9362-914745e84486 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:04.150642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b69e7872-0c0a-4087-9362-914745e84486 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:04.151108 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b69e7872-0c0a-4087-9362-914745e84486 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:04.151645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b69e7872-0c0a-4087-9362-914745e84486 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:04.153061 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b69e7872-0c0a-4087-9362-914745e84486 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:04.153804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b69e7872-0c0a-4087-9362-914745e84486 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:04.154236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b69e7872-0c0a-4087-9362-914745e84486 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:04.453067 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b69e7872-0c0a-4087-9362-914745e84486 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:04.464258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b69e7872-0c0a-4087-9362-914745e84486 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.329030 Aug 29 20:34:04.464258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 85/172] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:04 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:05.485497 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1dfe77fd-fd54-45fe-9c4f-68e22a41bc5a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:05.487137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1dfe77fd-fd54-45fe-9c4f-68e22a41bc5a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:05.496058 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dfe77fd-fd54-45fe-9c4f-68e22a41bc5a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:05.503664 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dfe77fd-fd54-45fe-9c4f-68e22a41bc5a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:05.504412 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dfe77fd-fd54-45fe-9c4f-68e22a41bc5a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:05.506304 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dfe77fd-fd54-45fe-9c4f-68e22a41bc5a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:05.511669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dfe77fd-fd54-45fe-9c4f-68e22a41bc5a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:05.512427 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dfe77fd-fd54-45fe-9c4f-68e22a41bc5a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:05.792338 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1dfe77fd-fd54-45fe-9c4f-68e22a41bc5a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:05.806723 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1dfe77fd-fd54-45fe-9c4f-68e22a41bc5a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.324843 Aug 29 20:34:05.808368 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 88/173] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:05 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:06.840693 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-63ac568e-9549-4a79-a6d3-cfa12218d1a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:06.842242 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-63ac568e-9549-4a79-a6d3-cfa12218d1a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:06.863123 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-63ac568e-9549-4a79-a6d3-cfa12218d1a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:06.864658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-63ac568e-9549-4a79-a6d3-cfa12218d1a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:06.866691 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-63ac568e-9549-4a79-a6d3-cfa12218d1a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:06.868553 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-63ac568e-9549-4a79-a6d3-cfa12218d1a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:06.870117 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-63ac568e-9549-4a79-a6d3-cfa12218d1a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:06.870942 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-63ac568e-9549-4a79-a6d3-cfa12218d1a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:07.139504 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-63ac568e-9549-4a79-a6d3-cfa12218d1a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:07.175590 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-63ac568e-9549-4a79-a6d3-cfa12218d1a7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.342663 Aug 29 20:34:07.176557 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 86/174] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:06 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:07.804992 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7bce5422-c85c-42da-bc39-3f24a5d6af44 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:07.806327 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7bce5422-c85c-42da-bc39-3f24a5d6af44 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:07.813998 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bce5422-c85c-42da-bc39-3f24a5d6af44 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:07.814864 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bce5422-c85c-42da-bc39-3f24a5d6af44 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:07.815538 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bce5422-c85c-42da-bc39-3f24a5d6af44 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:07.816507 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bce5422-c85c-42da-bc39-3f24a5d6af44 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:07.816975 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bce5422-c85c-42da-bc39-3f24a5d6af44 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:07.817530 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bce5422-c85c-42da-bc39-3f24a5d6af44 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:07.846272 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7bce5422-c85c-42da-bc39-3f24a5d6af44 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:34:07.965542 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7bce5422-c85c-42da-bc39-3f24a5d6af44 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "DELETE /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 204 len: 0 microversion: 2.1 time: 0.165578 Aug 29 20:34:07.967015 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 89/175] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:34:07 2022] DELETE /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:34:07.977767 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-c5b7d7c2-51b0-4085-98d1-d589b3d8394d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:07.978517 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-c5b7d7c2-51b0-4085-98d1-d589b3d8394d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:07.985198 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5b7d7c2-51b0-4085-98d1-d589b3d8394d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:07.985956 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5b7d7c2-51b0-4085-98d1-d589b3d8394d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:07.986391 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5b7d7c2-51b0-4085-98d1-d589b3d8394d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:07.987504 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5b7d7c2-51b0-4085-98d1-d589b3d8394d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:07.987998 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5b7d7c2-51b0-4085-98d1-d589b3d8394d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:07.988587 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5b7d7c2-51b0-4085-98d1-d589b3d8394d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:08.145735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-c5b7d7c2-51b0-4085-98d1-d589b3d8394d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:08.159281 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c5b7d7c2-51b0-4085-98d1-d589b3d8394d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1554 microversion: 2.1 time: 0.185937 Aug 29 20:34:08.160268 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 87/176] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:07 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:08.203298 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e1717918-7d4e-4e3d-8c4a-bd4766d3e253 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:08.204027 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e1717918-7d4e-4e3d-8c4a-bd4766d3e253 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:08.210838 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1717918-7d4e-4e3d-8c4a-bd4766d3e253 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:08.211711 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1717918-7d4e-4e3d-8c4a-bd4766d3e253 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:08.212400 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1717918-7d4e-4e3d-8c4a-bd4766d3e253 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:08.213136 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1717918-7d4e-4e3d-8c4a-bd4766d3e253 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:08.213770 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1717918-7d4e-4e3d-8c4a-bd4766d3e253 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:08.214203 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1717918-7d4e-4e3d-8c4a-bd4766d3e253 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:08.375075 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e1717918-7d4e-4e3d-8c4a-bd4766d3e253 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:08.393376 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e1717918-7d4e-4e3d-8c4a-bd4766d3e253 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.194472 Aug 29 20:34:08.393995 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 90/177] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:08 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:09.184432 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-80b6e697-c417-4e55-badb-f3e5c1bccda5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:09.185038 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-80b6e697-c417-4e55-badb-f3e5c1bccda5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:09.192158 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80b6e697-c417-4e55-badb-f3e5c1bccda5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:09.192655 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80b6e697-c417-4e55-badb-f3e5c1bccda5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:09.193092 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80b6e697-c417-4e55-badb-f3e5c1bccda5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:09.193820 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80b6e697-c417-4e55-badb-f3e5c1bccda5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:09.194317 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80b6e697-c417-4e55-badb-f3e5c1bccda5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:09.195233 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80b6e697-c417-4e55-badb-f3e5c1bccda5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:09.365680 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-80b6e697-c417-4e55-badb-f3e5c1bccda5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:09.370861 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:09.378923 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-80b6e697-c417-4e55-badb-f3e5c1bccda5 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1554 microversion: 2.1 time: 0.198415 Aug 29 20:34:09.379552 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 88/178] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:09 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:09.421032 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3c6f5419-89c1-46b5-a9e7-cd56e5a12a9c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:09.421785 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3c6f5419-89c1-46b5-a9e7-cd56e5a12a9c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:09.428357 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c6f5419-89c1-46b5-a9e7-cd56e5a12a9c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:09.428896 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c6f5419-89c1-46b5-a9e7-cd56e5a12a9c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:09.430011 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c6f5419-89c1-46b5-a9e7-cd56e5a12a9c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:09.430815 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c6f5419-89c1-46b5-a9e7-cd56e5a12a9c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:09.431369 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c6f5419-89c1-46b5-a9e7-cd56e5a12a9c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:09.431920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c6f5419-89c1-46b5-a9e7-cd56e5a12a9c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:09.604425 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3c6f5419-89c1-46b5-a9e7-cd56e5a12a9c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:09.612384 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3c6f5419-89c1-46b5-a9e7-cd56e5a12a9c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.195201 Aug 29 20:34:09.612957 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 91/179] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:09 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:10.402128 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-5b96c1b0-26a3-4198-b9bd-4d85aaa80ce1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:10.402740 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-5b96c1b0-26a3-4198-b9bd-4d85aaa80ce1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:10.411117 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5b96c1b0-26a3-4198-b9bd-4d85aaa80ce1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:10.411601 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5b96c1b0-26a3-4198-b9bd-4d85aaa80ce1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:10.412070 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5b96c1b0-26a3-4198-b9bd-4d85aaa80ce1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:10.412771 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5b96c1b0-26a3-4198-b9bd-4d85aaa80ce1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:10.413222 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5b96c1b0-26a3-4198-b9bd-4d85aaa80ce1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:10.414238 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5b96c1b0-26a3-4198-b9bd-4d85aaa80ce1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:10.565761 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-5b96c1b0-26a3-4198-b9bd-4d85aaa80ce1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:10.574948 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-5b96c1b0-26a3-4198-b9bd-4d85aaa80ce1 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1554 microversion: 2.1 time: 0.177296 Aug 29 20:34:10.575601 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 89/180] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:10 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:10.634725 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cd67e403-1ace-446a-a4b8-04a64251b7b2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:10.635571 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cd67e403-1ace-446a-a4b8-04a64251b7b2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:10.641838 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd67e403-1ace-446a-a4b8-04a64251b7b2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:10.642317 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd67e403-1ace-446a-a4b8-04a64251b7b2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:10.642766 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd67e403-1ace-446a-a4b8-04a64251b7b2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:10.643445 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd67e403-1ace-446a-a4b8-04a64251b7b2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:10.643890 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd67e403-1ace-446a-a4b8-04a64251b7b2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:10.644347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd67e403-1ace-446a-a4b8-04a64251b7b2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:10.795499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-cd67e403-1ace-446a-a4b8-04a64251b7b2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:10.804138 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cd67e403-1ace-446a-a4b8-04a64251b7b2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.174052 Aug 29 20:34:10.804754 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 92/181] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:10 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:11.608517 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-69e4bbd5-d7b4-486e-b6b4-9d0f8757baaf tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:11.609192 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-69e4bbd5-d7b4-486e-b6b4-9d0f8757baaf tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:11.619409 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-69e4bbd5-d7b4-486e-b6b4-9d0f8757baaf tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:11.620767 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-69e4bbd5-d7b4-486e-b6b4-9d0f8757baaf tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:11.621531 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-69e4bbd5-d7b4-486e-b6b4-9d0f8757baaf tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:11.622703 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-69e4bbd5-d7b4-486e-b6b4-9d0f8757baaf tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:11.623477 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-69e4bbd5-d7b4-486e-b6b4-9d0f8757baaf tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:11.623995 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-69e4bbd5-d7b4-486e-b6b4-9d0f8757baaf tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:11.830524 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb07c305-3c31-4ea9-acf4-c253ed3ad794 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:11.831605 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb07c305-3c31-4ea9-acf4-c253ed3ad794 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:11.845904 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb07c305-3c31-4ea9-acf4-c253ed3ad794 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:11.846708 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb07c305-3c31-4ea9-acf4-c253ed3ad794 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:11.847242 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb07c305-3c31-4ea9-acf4-c253ed3ad794 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:11.849215 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb07c305-3c31-4ea9-acf4-c253ed3ad794 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:11.853688 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb07c305-3c31-4ea9-acf4-c253ed3ad794 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:11.854232 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb07c305-3c31-4ea9-acf4-c253ed3ad794 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:11.882017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-69e4bbd5-d7b4-486e-b6b4-9d0f8757baaf tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:11.893706 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-69e4bbd5-d7b4-486e-b6b4-9d0f8757baaf tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1554 microversion: 2.1 time: 0.292497 Aug 29 20:34:11.895541 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 90/182] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:11 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1554 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:12.035844 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-eb07c305-3c31-4ea9-acf4-c253ed3ad794 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:12.044410 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb07c305-3c31-4ea9-acf4-c253ed3ad794 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.218961 Aug 29 20:34:12.045121 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 93/183] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:11 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:12.918326 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-fba0c62f-0487-41e8-8b2e-d99a1f6b805e tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:12.918930 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-fba0c62f-0487-41e8-8b2e-d99a1f6b805e tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:12.925637 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fba0c62f-0487-41e8-8b2e-d99a1f6b805e tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:12.926121 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fba0c62f-0487-41e8-8b2e-d99a1f6b805e tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:12.926553 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fba0c62f-0487-41e8-8b2e-d99a1f6b805e tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:12.927252 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fba0c62f-0487-41e8-8b2e-d99a1f6b805e tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:12.927976 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fba0c62f-0487-41e8-8b2e-d99a1f6b805e tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:12.928402 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fba0c62f-0487-41e8-8b2e-d99a1f6b805e tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:13.059226 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-fba0c62f-0487-41e8-8b2e-d99a1f6b805e tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:13.067061 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-da1d0536-18f4-464a-92c9-aeac1f3d73df tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:13.067849 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-fba0c62f-0487-41e8-8b2e-d99a1f6b805e tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1554 microversion: 2.1 time: 0.154165 Aug 29 20:34:13.068010 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-da1d0536-18f4-464a-92c9-aeac1f3d73df tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:13.068448 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 91/184] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:12 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:13.074624 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1d0536-18f4-464a-92c9-aeac1f3d73df tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:13.075091 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1d0536-18f4-464a-92c9-aeac1f3d73df tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:13.075511 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1d0536-18f4-464a-92c9-aeac1f3d73df tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:13.076287 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1d0536-18f4-464a-92c9-aeac1f3d73df tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:13.076723 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1d0536-18f4-464a-92c9-aeac1f3d73df tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:13.077141 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1d0536-18f4-464a-92c9-aeac1f3d73df tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:13.220036 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-da1d0536-18f4-464a-92c9-aeac1f3d73df tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:13.223670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:13.228918 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-da1d0536-18f4-464a-92c9-aeac1f3d73df tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.165755 Aug 29 20:34:13.229499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 94/185] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:13 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:14.089777 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-93399bf8-a601-4ede-a0dc-dcaae47588ab tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:14.090397 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-93399bf8-a601-4ede-a0dc-dcaae47588ab tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:14.096609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-93399bf8-a601-4ede-a0dc-dcaae47588ab tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:14.097097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-93399bf8-a601-4ede-a0dc-dcaae47588ab tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:14.097529 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-93399bf8-a601-4ede-a0dc-dcaae47588ab tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:14.098239 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-93399bf8-a601-4ede-a0dc-dcaae47588ab tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:14.098690 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-93399bf8-a601-4ede-a0dc-dcaae47588ab tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:14.099109 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-93399bf8-a601-4ede-a0dc-dcaae47588ab tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:14.238723 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-93399bf8-a601-4ede-a0dc-dcaae47588ab tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:14.248644 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-93399bf8-a601-4ede-a0dc-dcaae47588ab tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1554 microversion: 2.1 time: 0.163257 Aug 29 20:34:14.249511 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 92/186] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:14 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:14.252028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-35122be7-631f-45ce-b5f1-182c6f3c2919 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:14.252685 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-35122be7-631f-45ce-b5f1-182c6f3c2919 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:14.261776 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35122be7-631f-45ce-b5f1-182c6f3c2919 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:14.262270 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35122be7-631f-45ce-b5f1-182c6f3c2919 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:14.262704 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35122be7-631f-45ce-b5f1-182c6f3c2919 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:14.263402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35122be7-631f-45ce-b5f1-182c6f3c2919 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:14.263849 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35122be7-631f-45ce-b5f1-182c6f3c2919 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:14.264299 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-35122be7-631f-45ce-b5f1-182c6f3c2919 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:14.412418 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-35122be7-631f-45ce-b5f1-182c6f3c2919 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:14.420751 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-35122be7-631f-45ce-b5f1-182c6f3c2919 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.172886 Aug 29 20:34:14.421880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 95/187] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:14 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:15.270623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-bb7d4af8-7c18-4866-974b-982e5a2be8ec tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:15.271141 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-bb7d4af8-7c18-4866-974b-982e5a2be8ec tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:15.277720 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bb7d4af8-7c18-4866-974b-982e5a2be8ec tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:15.278115 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bb7d4af8-7c18-4866-974b-982e5a2be8ec tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:15.278548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bb7d4af8-7c18-4866-974b-982e5a2be8ec tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:15.279247 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bb7d4af8-7c18-4866-974b-982e5a2be8ec tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:15.279693 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bb7d4af8-7c18-4866-974b-982e5a2be8ec tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:15.280169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bb7d4af8-7c18-4866-974b-982e5a2be8ec tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:15.420560 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-bb7d4af8-7c18-4866-974b-982e5a2be8ec tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:15.428979 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-bb7d4af8-7c18-4866-974b-982e5a2be8ec tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1554 microversion: 2.1 time: 0.162332 Aug 29 20:34:15.430066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 93/188] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:15 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:15.443752 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b6f85448-0eb3-40a2-8fbe-be07f6e8fb11 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:15.444457 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b6f85448-0eb3-40a2-8fbe-be07f6e8fb11 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:15.451027 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6f85448-0eb3-40a2-8fbe-be07f6e8fb11 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:15.451501 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6f85448-0eb3-40a2-8fbe-be07f6e8fb11 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:15.451926 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6f85448-0eb3-40a2-8fbe-be07f6e8fb11 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:15.452645 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6f85448-0eb3-40a2-8fbe-be07f6e8fb11 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:15.453094 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6f85448-0eb3-40a2-8fbe-be07f6e8fb11 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:15.453512 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6f85448-0eb3-40a2-8fbe-be07f6e8fb11 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:15.719513 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6f85448-0eb3-40a2-8fbe-be07f6e8fb11 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:15.727422 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b6f85448-0eb3-40a2-8fbe-be07f6e8fb11 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.288089 Aug 29 20:34:15.728011 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 96/189] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:15 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:16.293981 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-f78284b0-9dbe-42c4-81cc-e012b2b6aaa3 req-b61b07d8-99e9-4077-9768-dbafe0be9aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150aa4a3-390c-4eb1-91ea-236f55e59e57", "name": "network-vif-deleted", "tag": "2cdd540d-17e7-4430-81b9-58cbfc6bfafc"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:16.311749 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-f78284b0-9dbe-42c4-81cc-e012b2b6aaa3 req-b61b07d8-99e9-4077-9768-dbafe0be9aa8 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:16.312258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-f78284b0-9dbe-42c4-81cc-e012b2b6aaa3 req-b61b07d8-99e9-4077-9768-dbafe0be9aa8 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:16.312695 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-f78284b0-9dbe-42c4-81cc-e012b2b6aaa3 req-b61b07d8-99e9-4077-9768-dbafe0be9aa8 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:16.325485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-f78284b0-9dbe-42c4-81cc-e012b2b6aaa3 req-b61b07d8-99e9-4077-9768-dbafe0be9aa8 service nova] Creating event network-vif-deleted:2cdd540d-17e7-4430-81b9-58cbfc6bfafc for instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 on hv-cinder-85426 Aug 29 20:34:16.331002 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-f78284b0-9dbe-42c4-81cc-e012b2b6aaa3 req-b61b07d8-99e9-4077-9768-dbafe0be9aa8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045620 Aug 29 20:34:16.331609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 94/190] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:34:16.450529 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6c812fc0-295a-4983-a771-8adaef4e702d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:16.451151 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6c812fc0-295a-4983-a771-8adaef4e702d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:16.459161 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c812fc0-295a-4983-a771-8adaef4e702d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:16.459659 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c812fc0-295a-4983-a771-8adaef4e702d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:16.460139 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c812fc0-295a-4983-a771-8adaef4e702d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:16.461378 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c812fc0-295a-4983-a771-8adaef4e702d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:16.461844 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c812fc0-295a-4983-a771-8adaef4e702d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:16.462274 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c812fc0-295a-4983-a771-8adaef4e702d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:16.526587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6c812fc0-295a-4983-a771-8adaef4e702d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:16.534804 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6c812fc0-295a-4983-a771-8adaef4e702d tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1512 microversion: 2.1 time: 0.088122 Aug 29 20:34:16.535378 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 97/191] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:16 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1512 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:16.749164 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8c9778a0-e419-4ae5-bb57-497f56fef715 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:16.749977 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8c9778a0-e419-4ae5-bb57-497f56fef715 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:16.756107 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c9778a0-e419-4ae5-bb57-497f56fef715 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:16.756579 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c9778a0-e419-4ae5-bb57-497f56fef715 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:16.757007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c9778a0-e419-4ae5-bb57-497f56fef715 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:16.758294 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c9778a0-e419-4ae5-bb57-497f56fef715 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:16.758821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c9778a0-e419-4ae5-bb57-497f56fef715 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:16.759238 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c9778a0-e419-4ae5-bb57-497f56fef715 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:16.894276 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8c9778a0-e419-4ae5-bb57-497f56fef715 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:16.902964 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8c9778a0-e419-4ae5-bb57-497f56fef715 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.158161 Aug 29 20:34:16.903535 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 95/192] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:16 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:17.557711 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ccb292f8-a537-45ca-a381-91bf31724d75 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:17.558528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ccb292f8-a537-45ca-a381-91bf31724d75 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:17.564619 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccb292f8-a537-45ca-a381-91bf31724d75 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:17.565008 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccb292f8-a537-45ca-a381-91bf31724d75 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:17.565444 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccb292f8-a537-45ca-a381-91bf31724d75 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:17.566141 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccb292f8-a537-45ca-a381-91bf31724d75 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:17.566669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccb292f8-a537-45ca-a381-91bf31724d75 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:17.567090 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ccb292f8-a537-45ca-a381-91bf31724d75 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:17.629836 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ccb292f8-a537-45ca-a381-91bf31724d75 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:17.640813 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ccb292f8-a537-45ca-a381-91bf31724d75 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1346 microversion: 2.1 time: 0.087749 Aug 29 20:34:17.641505 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 98/193] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:17 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:17.924891 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-19b0122e-723d-466b-b894-e0feca40b686 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:17.925485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-19b0122e-723d-466b-b894-e0feca40b686 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:17.932142 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-19b0122e-723d-466b-b894-e0feca40b686 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:17.932618 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-19b0122e-723d-466b-b894-e0feca40b686 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:17.933046 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-19b0122e-723d-466b-b894-e0feca40b686 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:17.933727 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-19b0122e-723d-466b-b894-e0feca40b686 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:17.934172 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-19b0122e-723d-466b-b894-e0feca40b686 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:17.934587 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-19b0122e-723d-466b-b894-e0feca40b686 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:18.075375 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-19b0122e-723d-466b-b894-e0feca40b686 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:18.084245 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-19b0122e-723d-466b-b894-e0feca40b686 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.163118 Aug 29 20:34:18.084817 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 96/194] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:17 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:18.667869 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e49f33e3-18bd-40d0-bd11-3725a8059a21 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:18.668475 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e49f33e3-18bd-40d0-bd11-3725a8059a21 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:18.674683 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e49f33e3-18bd-40d0-bd11-3725a8059a21 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:18.675186 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e49f33e3-18bd-40d0-bd11-3725a8059a21 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:18.676403 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e49f33e3-18bd-40d0-bd11-3725a8059a21 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:18.676403 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e49f33e3-18bd-40d0-bd11-3725a8059a21 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:18.676924 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e49f33e3-18bd-40d0-bd11-3725a8059a21 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:18.677186 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e49f33e3-18bd-40d0-bd11-3725a8059a21 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:18.743284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e49f33e3-18bd-40d0-bd11-3725a8059a21 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:18.751559 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e49f33e3-18bd-40d0-bd11-3725a8059a21 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1346 microversion: 2.1 time: 0.089046 Aug 29 20:34:18.752158 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 99/195] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:18 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:19.105294 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-31a3d589-51ca-469e-b479-0261890a03c9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:19.106135 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-31a3d589-51ca-469e-b479-0261890a03c9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:19.112942 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31a3d589-51ca-469e-b479-0261890a03c9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:19.113447 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31a3d589-51ca-469e-b479-0261890a03c9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:19.113898 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31a3d589-51ca-469e-b479-0261890a03c9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:19.114605 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31a3d589-51ca-469e-b479-0261890a03c9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:19.115058 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31a3d589-51ca-469e-b479-0261890a03c9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:19.115504 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31a3d589-51ca-469e-b479-0261890a03c9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:19.294738 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-31a3d589-51ca-469e-b479-0261890a03c9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:19.308876 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-31a3d589-51ca-469e-b479-0261890a03c9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.207534 Aug 29 20:34:19.310039 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 97/196] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:19 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:19.772850 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-da1bde61-cbc7-4d03-93fe-59f8fe3ede5a tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:19.773544 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-da1bde61-cbc7-4d03-93fe-59f8fe3ede5a tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:19.782430 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1bde61-cbc7-4d03-93fe-59f8fe3ede5a tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:19.785083 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1bde61-cbc7-4d03-93fe-59f8fe3ede5a tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:19.786575 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1bde61-cbc7-4d03-93fe-59f8fe3ede5a tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:19.787476 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1bde61-cbc7-4d03-93fe-59f8fe3ede5a tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:19.789489 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1bde61-cbc7-4d03-93fe-59f8fe3ede5a tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:19.790908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1bde61-cbc7-4d03-93fe-59f8fe3ede5a tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:19.870945 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1bde61-cbc7-4d03-93fe-59f8fe3ede5a tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:19.872755 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1bde61-cbc7-4d03-93fe-59f8fe3ede5a tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:19.873687 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-da1bde61-cbc7-4d03-93fe-59f8fe3ede5a tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:19.874605 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-da1bde61-cbc7-4d03-93fe-59f8fe3ede5a tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lazy-loading 'fault' on Instance uuid 150aa4a3-390c-4eb1-91ea-236f55e59e57 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:34:19.958719 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-da1bde61-cbc7-4d03-93fe-59f8fe3ede5a tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03117ffa81334df8a3467adbfaf96059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6314d8436170404097713aa7764dff94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:19.970473 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-da1bde61-cbc7-4d03-93fe-59f8fe3ede5a tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 200 len: 1351 microversion: 2.1 time: 0.201404 Aug 29 20:34:19.971703 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 100/197] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:19 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 1351 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:20.332364 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-30e0e2be-2e53-4824-b457-1f45431b78f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:20.332965 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-30e0e2be-2e53-4824-b457-1f45431b78f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:20.343173 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-30e0e2be-2e53-4824-b457-1f45431b78f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:20.343646 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-30e0e2be-2e53-4824-b457-1f45431b78f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:20.344255 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-30e0e2be-2e53-4824-b457-1f45431b78f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:20.344967 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-30e0e2be-2e53-4824-b457-1f45431b78f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:20.345421 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-30e0e2be-2e53-4824-b457-1f45431b78f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:20.350193 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-30e0e2be-2e53-4824-b457-1f45431b78f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:20.615676 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-30e0e2be-2e53-4824-b457-1f45431b78f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:20.631986 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-30e0e2be-2e53-4824-b457-1f45431b78f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.303345 Aug 29 20:34:20.644514 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 98/198] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:20 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:20.992627 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-280e7474-fa4c-45e7-865e-5832307d6794 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:20.993540 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-280e7474-fa4c-45e7-865e-5832307d6794 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:21.001098 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-280e7474-fa4c-45e7-865e-5832307d6794 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:21.001829 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-280e7474-fa4c-45e7-865e-5832307d6794 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:21.002373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-280e7474-fa4c-45e7-865e-5832307d6794 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:21.003194 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-280e7474-fa4c-45e7-865e-5832307d6794 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:21.003916 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-280e7474-fa4c-45e7-865e-5832307d6794 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:21.004343 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-280e7474-fa4c-45e7-865e-5832307d6794 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:21.021423 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-280e7474-fa4c-45e7-865e-5832307d6794 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] HTTP exception thrown: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-280e7474-fa4c-45e7-865e-5832307d6794 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Request method failure captured: Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 HTTP/1.1 Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJ9DqxMFmdJtNoaiJl0zx0TSwKWpaYUe0HdSCA_uwXRSfgJ6GghIyn3fmqEznNDJH0RdLB-TFXvPhV19QIfRozblHJPjdXGH9T3v7K0QUMWVnvHv3O-dw28AKl5OgcXffECgadDVewdKwblEMDIPXlFtIYKFIYrB-OZ9_XyS-MGQj8 Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 6314d8436170404097713aa7764dff94 Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-1765781907 Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:34:21.031347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:34:21.033005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6314d8436170404097713aa7764dff94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6314d8436170404097713aa7764dff94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6314d8436170404097713aa7764dff94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6314d8436170404097713aa7764dff94"}]}] Aug 29 20:34:21.033005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-1765781907 Aug 29 20:34:21.033005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 6314d8436170404097713aa7764dff94 Aug 29 20:34:21.033005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-1765781907 Aug 29 20:34:21.033005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-1765781907-project Aug 29 20:34:21.033005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:34:21.033005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:34:21.033005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 03117ffa81334df8a3467adbfaf96059 Aug 29 20:34:21.033005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-1765781907-project Aug 29 20:34:21.033005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:34:21.033005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:21.033005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '150aa4a3-390c-4eb1-91ea-236f55e59e57'} Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:34:21.033764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:21.035474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:34:21.036720 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-280e7474-fa4c-45e7-865e-5832307d6794 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Returning 404 to user: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:34:21.036720 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-280e7474-fa4c-45e7-865e-5832307d6794 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 404 len: 111 microversion: 2.1 time: 0.045629 Aug 29 20:34:21.036720 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 101/199] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:20 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:34:21.167798 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-5a070a36-69e1-494b-abdf-fcee86911b50 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:21.170007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-5a070a36-69e1-494b-abdf-fcee86911b50 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:21.172088 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=50 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:21.177656 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5a070a36-69e1-494b-abdf-fcee86911b50 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:21.178140 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5a070a36-69e1-494b-abdf-fcee86911b50 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:21.178836 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5a070a36-69e1-494b-abdf-fcee86911b50 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:21.179529 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5a070a36-69e1-494b-abdf-fcee86911b50 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:21.180042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5a070a36-69e1-494b-abdf-fcee86911b50 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:21.180479 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5a070a36-69e1-494b-abdf-fcee86911b50 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:21.194937 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-5a070a36-69e1-494b-abdf-fcee86911b50 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] HTTP exception thrown: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-5a070a36-69e1-494b-abdf-fcee86911b50 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Request method failure captured: Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57/os-volume_attachments HTTP/1.1 Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSJ9DqxMFmdJtNoaiJl0zx0TSwKWpaYUe0HdSCA_uwXRSfgJ6GghIyn3fmqEznNDJH0RdLB-TFXvPhV19QIfRozblHJPjdXGH9T3v7K0QUMWVnvHv3O-dw28AKl5OgcXffECgadDVewdKwblEMDIPXlFtIYKFIYrB-OZ9_XyS-MGQj8 Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 6314d8436170404097713aa7764dff94 Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-DeleteServersTestJSON-1765781907 Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:34:21.199701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:34:21.202356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6314d8436170404097713aa7764dff94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6314d8436170404097713aa7764dff94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6314d8436170404097713aa7764dff94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6314d8436170404097713aa7764dff94"}]}] Aug 29 20:34:21.202356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-DeleteServersTestJSON-1765781907 Aug 29 20:34:21.202356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 6314d8436170404097713aa7764dff94 Aug 29 20:34:21.202356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-DeleteServersTestJSON-1765781907 Aug 29 20:34:21.202356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-DeleteServersTestJSON-1765781907-project Aug 29 20:34:21.202356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:34:21.202356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:34:21.202356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 03117ffa81334df8a3467adbfaf96059 Aug 29 20:34:21.202356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-DeleteServersTestJSON-1765781907-project Aug 29 20:34:21.202356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:34:21.202356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:21.202356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'server_id': '150aa4a3-390c-4eb1-91ea-236f55e59e57'} Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:34:21.203597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:21.206658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:34:21.208912 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-5a070a36-69e1-494b-abdf-fcee86911b50 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Returning 404 to user: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:34:21.208912 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-5a070a36-69e1-494b-abdf-fcee86911b50 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037452 Aug 29 20:34:21.208912 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 99/200] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:34:21 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:34:21.673067 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-47c4b4e0-f74d-4ecc-a194-d4c131b38475 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:21.674165 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-47c4b4e0-f74d-4ecc-a194-d4c131b38475 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:21.684312 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47c4b4e0-f74d-4ecc-a194-d4c131b38475 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:21.685301 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47c4b4e0-f74d-4ecc-a194-d4c131b38475 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:21.685944 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47c4b4e0-f74d-4ecc-a194-d4c131b38475 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:21.686641 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47c4b4e0-f74d-4ecc-a194-d4c131b38475 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:21.687181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47c4b4e0-f74d-4ecc-a194-d4c131b38475 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:21.687804 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47c4b4e0-f74d-4ecc-a194-d4c131b38475 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:21.866723 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-47c4b4e0-f74d-4ecc-a194-d4c131b38475 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:21.879750 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-47c4b4e0-f74d-4ecc-a194-d4c131b38475 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.212016 Aug 29 20:34:21.880577 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 102/201] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:21 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:22.905617 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1b84d476-4082-4ca5-9d19-840b990cc1f4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:22.906364 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1b84d476-4082-4ca5-9d19-840b990cc1f4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:22.914393 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1b84d476-4082-4ca5-9d19-840b990cc1f4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:22.914992 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1b84d476-4082-4ca5-9d19-840b990cc1f4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:22.915592 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1b84d476-4082-4ca5-9d19-840b990cc1f4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:22.917214 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1b84d476-4082-4ca5-9d19-840b990cc1f4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:22.917911 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1b84d476-4082-4ca5-9d19-840b990cc1f4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:22.919136 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1b84d476-4082-4ca5-9d19-840b990cc1f4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:23.112119 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1b84d476-4082-4ca5-9d19-840b990cc1f4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:23.121526 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1b84d476-4082-4ca5-9d19-840b990cc1f4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.219659 Aug 29 20:34:23.132352 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 100/202] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:22 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:24.144049 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-262fa3d3-b851-462e-a386-c5d38fb6ba59 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:24.145646 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-262fa3d3-b851-462e-a386-c5d38fb6ba59 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:24.155895 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-262fa3d3-b851-462e-a386-c5d38fb6ba59 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:24.156699 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-262fa3d3-b851-462e-a386-c5d38fb6ba59 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:24.157303 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-262fa3d3-b851-462e-a386-c5d38fb6ba59 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:24.158988 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-262fa3d3-b851-462e-a386-c5d38fb6ba59 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:24.159455 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-262fa3d3-b851-462e-a386-c5d38fb6ba59 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:24.159880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-262fa3d3-b851-462e-a386-c5d38fb6ba59 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:24.354898 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-262fa3d3-b851-462e-a386-c5d38fb6ba59 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:24.363105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-262fa3d3-b851-462e-a386-c5d38fb6ba59 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.223671 Aug 29 20:34:24.363693 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 103/203] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:24 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:24.571663 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-37a92952-8f6c-4110-b09a-1a0decbf9c77 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:24.573041 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-37a92952-8f6c-4110-b09a-1a0decbf9c77 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:24.580649 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-37a92952-8f6c-4110-b09a-1a0decbf9c77 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:24.581139 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-37a92952-8f6c-4110-b09a-1a0decbf9c77 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:24.581667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-37a92952-8f6c-4110-b09a-1a0decbf9c77 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:24.582539 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-37a92952-8f6c-4110-b09a-1a0decbf9c77 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:24.582993 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-37a92952-8f6c-4110-b09a-1a0decbf9c77 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:24.583409 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-37a92952-8f6c-4110-b09a-1a0decbf9c77 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:24.597622 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-37a92952-8f6c-4110-b09a-1a0decbf9c77 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] HTTP exception thrown: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-37a92952-8f6c-4110-b09a-1a0decbf9c77 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Request method failure captured: Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: DELETE /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 HTTP/1.1 Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSJ9DqxMFmdJtNoaiJl0zx0TSwKWpaYUe0HdSCA_uwXRSfgJ6GghIyn3fmqEznNDJH0RdLB-TFXvPhV19QIfRozblHJPjdXGH9T3v7K0QUMWVnvHv3O-dw28AKl5OgcXffECgadDVewdKwblEMDIPXlFtIYKFIYrB-OZ9_XyS-MGQj8 Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 6314d8436170404097713aa7764dff94 Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-DeleteServersTestJSON-1765781907 Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:34:24.599824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:34:24.600972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6314d8436170404097713aa7764dff94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6314d8436170404097713aa7764dff94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6314d8436170404097713aa7764dff94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6314d8436170404097713aa7764dff94"}]}] Aug 29 20:34:24.600972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-DeleteServersTestJSON-1765781907 Aug 29 20:34:24.600972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 6314d8436170404097713aa7764dff94 Aug 29 20:34:24.600972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-DeleteServersTestJSON-1765781907 Aug 29 20:34:24.600972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-DeleteServersTestJSON-1765781907-project Aug 29 20:34:24.600972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:34:24.600972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:34:24.600972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 03117ffa81334df8a3467adbfaf96059 Aug 29 20:34:24.600972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-DeleteServersTestJSON-1765781907-project Aug 29 20:34:24.600972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:34:24.600972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:24.600972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '150aa4a3-390c-4eb1-91ea-236f55e59e57'} Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:34:24.601735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:24.603231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:34:24.604589 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-37a92952-8f6c-4110-b09a-1a0decbf9c77 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Returning 404 to user: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:34:24.604589 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-37a92952-8f6c-4110-b09a-1a0decbf9c77 tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "DELETE /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 404 len: 111 microversion: 2.1 time: 0.037324 Aug 29 20:34:24.604589 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 101/204] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:34:24 2022] DELETE /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:34:24.614355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6f3bc9bb-553b-4783-83a2-49ae1215137f tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:24.615007 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6f3bc9bb-553b-4783-83a2-49ae1215137f tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] [instance: 150aa4a3-390c-4eb1-91ea-236f55e59e57] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:24.622961 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f3bc9bb-553b-4783-83a2-49ae1215137f tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:24.622961 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f3bc9bb-553b-4783-83a2-49ae1215137f tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:24.623317 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f3bc9bb-553b-4783-83a2-49ae1215137f tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:24.624063 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f3bc9bb-553b-4783-83a2-49ae1215137f tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:24.624568 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f3bc9bb-553b-4783-83a2-49ae1215137f tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:24.625849 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6f3bc9bb-553b-4783-83a2-49ae1215137f tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:24.640465 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-6f3bc9bb-553b-4783-83a2-49ae1215137f tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] HTTP exception thrown: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6f3bc9bb-553b-4783-83a2-49ae1215137f tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Request method failure captured: Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 HTTP/1.1 Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJ9DqxMFmdJtNoaiJl0zx0TSwKWpaYUe0HdSCA_uwXRSfgJ6GghIyn3fmqEznNDJH0RdLB-TFXvPhV19QIfRozblHJPjdXGH9T3v7K0QUMWVnvHv3O-dw28AKl5OgcXffECgadDVewdKwblEMDIPXlFtIYKFIYrB-OZ9_XyS-MGQj8 Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 6314d8436170404097713aa7764dff94 Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-DeleteServersTestJSON-1765781907 Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:34:24.641985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:34:24.643486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6314d8436170404097713aa7764dff94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6314d8436170404097713aa7764dff94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6314d8436170404097713aa7764dff94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6314d8436170404097713aa7764dff94"}]}] Aug 29 20:34:24.643486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-DeleteServersTestJSON-1765781907 Aug 29 20:34:24.643486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 6314d8436170404097713aa7764dff94 Aug 29 20:34:24.643486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-DeleteServersTestJSON-1765781907 Aug 29 20:34:24.643486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-DeleteServersTestJSON-1765781907-project Aug 29 20:34:24.643486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:34:24.643486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:34:24.643486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 03117ffa81334df8a3467adbfaf96059 Aug 29 20:34:24.643486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-DeleteServersTestJSON-1765781907-project Aug 29 20:34:24.643486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:34:24.643486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:24.643486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '150aa4a3-390c-4eb1-91ea-236f55e59e57'} Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:34:24.644322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. Aug 29 20:34:24.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:34:24.646308 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6f3bc9bb-553b-4783-83a2-49ae1215137f tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] Returning 404 to user: Instance 150aa4a3-390c-4eb1-91ea-236f55e59e57 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:34:24.646308 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6f3bc9bb-553b-4783-83a2-49ae1215137f tempest-DeleteServersTestJSON-1765781907 tempest-DeleteServersTestJSON-1765781907-project] 10.222.0.18 "GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57" status: 404 len: 111 microversion: 2.1 time: 0.034288 Aug 29 20:34:24.646308 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 104/205] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:24 2022] GET /compute/v2.1/servers/150aa4a3-390c-4eb1-91ea-236f55e59e57 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:34:25.417653 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-225f0d07-a453-425a-8aae-bfd01f633441 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:25.419183 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-225f0d07-a453-425a-8aae-bfd01f633441 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:25.429341 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-225f0d07-a453-425a-8aae-bfd01f633441 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:25.430388 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-225f0d07-a453-425a-8aae-bfd01f633441 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:25.431258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-225f0d07-a453-425a-8aae-bfd01f633441 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:25.432856 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-225f0d07-a453-425a-8aae-bfd01f633441 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:25.433699 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-225f0d07-a453-425a-8aae-bfd01f633441 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:25.434423 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-225f0d07-a453-425a-8aae-bfd01f633441 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:25.855096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-225f0d07-a453-425a-8aae-bfd01f633441 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:25.867225 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-225f0d07-a453-425a-8aae-bfd01f633441 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.466683 Aug 29 20:34:25.873266 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 102/206] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:25 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:26.896199 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1c9aba34-632f-4618-b4c0-d94035ba163e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:26.897406 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1c9aba34-632f-4618-b4c0-d94035ba163e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:26.904349 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c9aba34-632f-4618-b4c0-d94035ba163e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:26.905212 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c9aba34-632f-4618-b4c0-d94035ba163e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:26.905932 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c9aba34-632f-4618-b4c0-d94035ba163e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:26.906709 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c9aba34-632f-4618-b4c0-d94035ba163e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:26.907249 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c9aba34-632f-4618-b4c0-d94035ba163e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:26.907879 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1c9aba34-632f-4618-b4c0-d94035ba163e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:27.077415 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1c9aba34-632f-4618-b4c0-d94035ba163e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:27.086385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1c9aba34-632f-4618-b4c0-d94035ba163e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.195148 Aug 29 20:34:27.096523 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 105/207] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:26 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:28.113486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-c5ddfbd4-e50d-4f9c-be9b-b2ce5ff1e726 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:28.114911 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-c5ddfbd4-e50d-4f9c-be9b-b2ce5ff1e726 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:28.123473 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5ddfbd4-e50d-4f9c-be9b-b2ce5ff1e726 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:28.123981 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5ddfbd4-e50d-4f9c-be9b-b2ce5ff1e726 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:28.124856 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5ddfbd4-e50d-4f9c-be9b-b2ce5ff1e726 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:28.125953 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5ddfbd4-e50d-4f9c-be9b-b2ce5ff1e726 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:28.126582 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5ddfbd4-e50d-4f9c-be9b-b2ce5ff1e726 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:28.127283 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c5ddfbd4-e50d-4f9c-be9b-b2ce5ff1e726 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:28.405339 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-c5ddfbd4-e50d-4f9c-be9b-b2ce5ff1e726 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:28.414070 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c5ddfbd4-e50d-4f9c-be9b-b2ce5ff1e726 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.308734 Aug 29 20:34:28.416609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 103/208] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:28 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:29.437860 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7719f66e-8e50-4fb2-9e4a-93bf90859155 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:29.439570 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7719f66e-8e50-4fb2-9e4a-93bf90859155 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:29.450589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:29.452115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7719f66e-8e50-4fb2-9e4a-93bf90859155 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:29.453777 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7719f66e-8e50-4fb2-9e4a-93bf90859155 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:29.457062 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7719f66e-8e50-4fb2-9e4a-93bf90859155 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:29.458037 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7719f66e-8e50-4fb2-9e4a-93bf90859155 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:29.460829 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7719f66e-8e50-4fb2-9e4a-93bf90859155 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:29.462126 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7719f66e-8e50-4fb2-9e4a-93bf90859155 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:29.892543 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7719f66e-8e50-4fb2-9e4a-93bf90859155 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:29.905468 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7719f66e-8e50-4fb2-9e4a-93bf90859155 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.471181 Aug 29 20:34:29.923408 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 106/209] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:29 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:30.930398 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-962823d5-4cd9-47af-8767-cf2198f039b3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:30.931098 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-962823d5-4cd9-47af-8767-cf2198f039b3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:30.947296 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-962823d5-4cd9-47af-8767-cf2198f039b3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:30.947874 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-962823d5-4cd9-47af-8767-cf2198f039b3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:30.948420 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-962823d5-4cd9-47af-8767-cf2198f039b3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:30.949218 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-962823d5-4cd9-47af-8767-cf2198f039b3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:30.949737 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-962823d5-4cd9-47af-8767-cf2198f039b3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:30.950580 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-962823d5-4cd9-47af-8767-cf2198f039b3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:31.736905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-962823d5-4cd9-47af-8767-cf2198f039b3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:31.757330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-962823d5-4cd9-47af-8767-cf2198f039b3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.829034 Aug 29 20:34:31.760748 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 104/210] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:30 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:32.782415 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-25ce9e6b-3191-4a30-b7cd-ecdc965aea7d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:32.784803 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-25ce9e6b-3191-4a30-b7cd-ecdc965aea7d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:32.793158 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25ce9e6b-3191-4a30-b7cd-ecdc965aea7d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:32.794037 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25ce9e6b-3191-4a30-b7cd-ecdc965aea7d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:32.794749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25ce9e6b-3191-4a30-b7cd-ecdc965aea7d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:32.796230 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25ce9e6b-3191-4a30-b7cd-ecdc965aea7d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:32.797116 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25ce9e6b-3191-4a30-b7cd-ecdc965aea7d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:32.798875 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-25ce9e6b-3191-4a30-b7cd-ecdc965aea7d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:33.107884 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-25ce9e6b-3191-4a30-b7cd-ecdc965aea7d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:33.125065 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-25ce9e6b-3191-4a30-b7cd-ecdc965aea7d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.347151 Aug 29 20:34:33.132001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 107/211] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:32 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:34.150054 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-5b4489cd-9854-4e62-acb5-5fd9b270c0d4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:34.150714 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-5b4489cd-9854-4e62-acb5-5fd9b270c0d4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:34.167258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5b4489cd-9854-4e62-acb5-5fd9b270c0d4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:34.168215 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5b4489cd-9854-4e62-acb5-5fd9b270c0d4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:34.168977 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5b4489cd-9854-4e62-acb5-5fd9b270c0d4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:34.169896 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5b4489cd-9854-4e62-acb5-5fd9b270c0d4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:34.170665 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5b4489cd-9854-4e62-acb5-5fd9b270c0d4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:34.172444 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5b4489cd-9854-4e62-acb5-5fd9b270c0d4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:34.633078 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-5b4489cd-9854-4e62-acb5-5fd9b270c0d4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:34.646018 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-5b4489cd-9854-4e62-acb5-5fd9b270c0d4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1522 microversion: 2.1 time: 0.502744 Aug 29 20:34:34.646612 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 105/212] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:34 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:35.675325 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-258acc8b-72f6-4fa7-8d5f-44cb32669a7f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:35.676157 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-258acc8b-72f6-4fa7-8d5f-44cb32669a7f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:35.686627 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-258acc8b-72f6-4fa7-8d5f-44cb32669a7f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:35.687125 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-258acc8b-72f6-4fa7-8d5f-44cb32669a7f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:35.687599 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-258acc8b-72f6-4fa7-8d5f-44cb32669a7f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:35.688749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-258acc8b-72f6-4fa7-8d5f-44cb32669a7f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:35.690245 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-258acc8b-72f6-4fa7-8d5f-44cb32669a7f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:35.697970 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-258acc8b-72f6-4fa7-8d5f-44cb32669a7f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:36.348806 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-258acc8b-72f6-4fa7-8d5f-44cb32669a7f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:36.370030 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-258acc8b-72f6-4fa7-8d5f-44cb32669a7f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1502 microversion: 2.1 time: 0.700022 Aug 29 20:34:36.373803 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 108/213] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:35 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1502 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:36.392765 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-3a8735f6-7fee-464d-b668-d773c9e7dd24 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:36.393592 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-3a8735f6-7fee-464d-b668-d773c9e7dd24 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:36.411675 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3a8735f6-7fee-464d-b668-d773c9e7dd24 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:36.412085 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3a8735f6-7fee-464d-b668-d773c9e7dd24 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:36.412678 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3a8735f6-7fee-464d-b668-d773c9e7dd24 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:36.414397 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3a8735f6-7fee-464d-b668-d773c9e7dd24 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:36.417284 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3a8735f6-7fee-464d-b668-d773c9e7dd24 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:36.417963 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3a8735f6-7fee-464d-b668-d773c9e7dd24 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:36.700789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-3a8735f6-7fee-464d-b668-d773c9e7dd24 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:36.712791 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-3a8735f6-7fee-464d-b668-d773c9e7dd24 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1516 microversion: 2.1 time: 0.324699 Aug 29 20:34:36.715214 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 106/214] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:36 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1516 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:39.098564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e20b8374-58ac-4b85-a8da-2693ffe57b53 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:39.105589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e20b8374-58ac-4b85-a8da-2693ffe57b53 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:39.145036 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e20b8374-58ac-4b85-a8da-2693ffe57b53 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:39.146541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e20b8374-58ac-4b85-a8da-2693ffe57b53 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:39.148880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e20b8374-58ac-4b85-a8da-2693ffe57b53 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:39.151633 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e20b8374-58ac-4b85-a8da-2693ffe57b53 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:39.152963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e20b8374-58ac-4b85-a8da-2693ffe57b53 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:39.154088 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e20b8374-58ac-4b85-a8da-2693ffe57b53 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:39.232688 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-e20b8374-58ac-4b85-a8da-2693ffe57b53 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lazy-loading 'flavor' on Instance uuid 3db93852-3c79-43ac-8757-a41602e8bc53 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:34:39.502219 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e20b8374-58ac-4b85-a8da-2693ffe57b53 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "POST /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53/action" status: 200 len: 32 microversion: 2.1 time: 0.411964 Aug 29 20:34:39.504497 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 109/215] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 29 20:34:39 2022] POST /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53/action => generated 32 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 20:34:39.515221 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-3ec690a9-22a4-4faa-8d27-fa6cf508ce3f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:39.516312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-3ec690a9-22a4-4faa-8d27-fa6cf508ce3f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:39.538339 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3ec690a9-22a4-4faa-8d27-fa6cf508ce3f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:39.539281 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3ec690a9-22a4-4faa-8d27-fa6cf508ce3f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:39.545412 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3ec690a9-22a4-4faa-8d27-fa6cf508ce3f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:39.546202 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3ec690a9-22a4-4faa-8d27-fa6cf508ce3f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:39.546700 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3ec690a9-22a4-4faa-8d27-fa6cf508ce3f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:39.547129 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3ec690a9-22a4-4faa-8d27-fa6cf508ce3f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:39.601051 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=100 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:39.936680 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-3ec690a9-22a4-4faa-8d27-fa6cf508ce3f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:39.954424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-3ec690a9-22a4-4faa-8d27-fa6cf508ce3f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.441182 Aug 29 20:34:39.968655 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 107/216] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:39 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:40.945129 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1060992871", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:40.981418 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-c713b77b-1a01-4e88-9fd1-882cedb8dce3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:40.982084 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-c713b77b-1a01-4e88-9fd1-882cedb8dce3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:40.988697 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c713b77b-1a01-4e88-9fd1-882cedb8dce3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:41.003827 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c713b77b-1a01-4e88-9fd1-882cedb8dce3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:41.004657 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c713b77b-1a01-4e88-9fd1-882cedb8dce3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:41.005850 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c713b77b-1a01-4e88-9fd1-882cedb8dce3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:41.006606 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c713b77b-1a01-4e88-9fd1-882cedb8dce3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:41.016494 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c713b77b-1a01-4e88-9fd1-882cedb8dce3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:41.106713 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] validate_networks() for None {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:34:41.434004 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-c713b77b-1a01-4e88-9fd1-882cedb8dce3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:41.442973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c713b77b-1a01-4e88-9fd1-882cedb8dce3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.465808 Aug 29 20:34:41.450703 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 108/217] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:40 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:42.134974 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:34:42.135782 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:34:42.136686 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:34:42.137547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:34:42.138501 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:34:42.154541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:42.155889 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:42.156534 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:42.157962 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:42.158587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:42.159228 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:42.263728 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Getting quotas for project e4de197062eb48adb3f8af1a1f8e958c. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:34:42.278421 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Getting quotas for user 39abe902a6534e80affc78acafc0ab31 and project e4de197062eb48adb3f8af1a1f8e958c. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:34:42.294274 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:34:42.299573 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:34:42.375838 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-419f5df5-6e58-4761-9872-75d8e0d2e47c tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440065 Aug 29 20:34:42.383502 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 110/218] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:34:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:34:42.387273 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6f51cf43-1bcf-4721-9077-5d0760db3093 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:42.391835 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6f51cf43-1bcf-4721-9077-5d0760db3093 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:42.486193 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-79e73a5a-d5d7-4983-a399-7f687bdc8238 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:42.489367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-79e73a5a-d5d7-4983-a399-7f687bdc8238 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:42.546049 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79e73a5a-d5d7-4983-a399-7f687bdc8238 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:42.546889 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79e73a5a-d5d7-4983-a399-7f687bdc8238 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:42.547788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79e73a5a-d5d7-4983-a399-7f687bdc8238 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:42.550818 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79e73a5a-d5d7-4983-a399-7f687bdc8238 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:42.551950 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79e73a5a-d5d7-4983-a399-7f687bdc8238 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:42.552905 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79e73a5a-d5d7-4983-a399-7f687bdc8238 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:42.566805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:42.843420 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-6f51cf43-1bcf-4721-9077-5d0760db3093 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:42.849866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6f51cf43-1bcf-4721-9077-5d0760db3093 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1215 microversion: 2.1 time: 0.466344 Aug 29 20:34:42.872388 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 109/219] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:42 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1215 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:43.413770 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-79e73a5a-d5d7-4983-a399-7f687bdc8238 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:43.422098 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-79e73a5a-d5d7-4983-a399-7f687bdc8238 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.951349 Aug 29 20:34:43.426064 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 111/220] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:42 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:43.871323 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8df02cc1-b579-4a8f-a468-967e48d95a49 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:43.871987 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8df02cc1-b579-4a8f-a468-967e48d95a49 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:43.895441 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8df02cc1-b579-4a8f-a468-967e48d95a49 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:43.896023 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8df02cc1-b579-4a8f-a468-967e48d95a49 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:43.896403 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8df02cc1-b579-4a8f-a468-967e48d95a49 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:43.897120 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8df02cc1-b579-4a8f-a468-967e48d95a49 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:43.899492 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8df02cc1-b579-4a8f-a468-967e48d95a49 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:43.908418 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8df02cc1-b579-4a8f-a468-967e48d95a49 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:44.236496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8df02cc1-b579-4a8f-a468-967e48d95a49 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:44.264785 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8df02cc1-b579-4a8f-a468-967e48d95a49 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1219 microversion: 2.1 time: 0.394347 Aug 29 20:34:44.282204 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 110/221] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:43 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1219 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:44.453142 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-22cf3f85-c5a4-4a3e-a7f3-c322d6c58c54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:44.454053 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-22cf3f85-c5a4-4a3e-a7f3-c322d6c58c54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:44.471115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22cf3f85-c5a4-4a3e-a7f3-c322d6c58c54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:44.471956 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22cf3f85-c5a4-4a3e-a7f3-c322d6c58c54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:44.472609 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22cf3f85-c5a4-4a3e-a7f3-c322d6c58c54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:44.474978 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22cf3f85-c5a4-4a3e-a7f3-c322d6c58c54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:44.475559 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22cf3f85-c5a4-4a3e-a7f3-c322d6c58c54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:44.476130 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-22cf3f85-c5a4-4a3e-a7f3-c322d6c58c54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:44.879265 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-22cf3f85-c5a4-4a3e-a7f3-c322d6c58c54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:44.889923 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-22cf3f85-c5a4-4a3e-a7f3-c322d6c58c54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.441504 Aug 29 20:34:44.890512 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 112/222] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:44 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:45.287059 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e21978b2-a84d-48d5-86be-bc5550dde582 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:45.288880 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e21978b2-a84d-48d5-86be-bc5550dde582 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:45.302977 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e21978b2-a84d-48d5-86be-bc5550dde582 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:45.303734 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e21978b2-a84d-48d5-86be-bc5550dde582 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:45.305317 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e21978b2-a84d-48d5-86be-bc5550dde582 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:45.308370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e21978b2-a84d-48d5-86be-bc5550dde582 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:45.309368 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e21978b2-a84d-48d5-86be-bc5550dde582 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:45.312178 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e21978b2-a84d-48d5-86be-bc5550dde582 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:45.557532 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e21978b2-a84d-48d5-86be-bc5550dde582 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:45.573496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e21978b2-a84d-48d5-86be-bc5550dde582 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1211 microversion: 2.1 time: 0.290242 Aug 29 20:34:45.593152 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 111/223] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:45 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1211 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:45.756689 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b3194dd5-cbfc-4549-aeda-50250eb7c7b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Action: 'create', calling method: .version_select at 0x7f48634b2550>, body: {"keypair": {"name": "tempest-keypair-12196286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOdvMDDEXKQFS8NRUy2NHEWNgFe3ZnnuaPcVFRYke+s0PjS5eVwMBhMsMUsFdWfd0D20MbVoU/4jsjQGwAyZykLca2nMd9Xb4fTulYA/MPzT/9goLdPJ9VTfIxTvnhW2g=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:45.900506 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-b3194dd5-cbfc-4549-aeda-50250eb7c7b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Getting quotas for project bf00868e84384ee59320184a5e1c46c8. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:34:45.916963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-b3194dd5-cbfc-4549-aeda-50250eb7c7b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Getting quotas for user 068f28eb74e74650a2b80d29664109ae and project bf00868e84384ee59320184a5e1c46c8. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:34:45.934848 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a2e72f14-b71a-450c-830a-105e17577738 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:45.939585 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a2e72f14-b71a-450c-830a-105e17577738 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:45.980372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a2e72f14-b71a-450c-830a-105e17577738 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:45.981031 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a2e72f14-b71a-450c-830a-105e17577738 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:45.983664 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a2e72f14-b71a-450c-830a-105e17577738 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:45.989487 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a2e72f14-b71a-450c-830a-105e17577738 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:45.998376 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a2e72f14-b71a-450c-830a-105e17577738 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:46.003005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b3194dd5-cbfc-4549-aeda-50250eb7c7b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.501329 Aug 29 20:34:46.003559 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a2e72f14-b71a-450c-830a-105e17577738 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:46.015773 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 113/224] 10.222.0.18 () {62 vars in 1200 bytes} [Mon Aug 29 20:34:45 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 516 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 20:34:46.294931 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a2e72f14-b71a-450c-830a-105e17577738 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:46.323074 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a2e72f14-b71a-450c-830a-105e17577738 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.402902 Aug 29 20:34:46.331634 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 112/225] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:45 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:46.602296 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-68068256-0454-4bbc-b0d1-b5b0a9e66e40 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:46.603783 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-68068256-0454-4bbc-b0d1-b5b0a9e66e40 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:46.633894 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68068256-0454-4bbc-b0d1-b5b0a9e66e40 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:46.635174 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68068256-0454-4bbc-b0d1-b5b0a9e66e40 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:46.636594 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68068256-0454-4bbc-b0d1-b5b0a9e66e40 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:46.637634 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68068256-0454-4bbc-b0d1-b5b0a9e66e40 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:46.638582 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68068256-0454-4bbc-b0d1-b5b0a9e66e40 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:46.639681 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68068256-0454-4bbc-b0d1-b5b0a9e66e40 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:46.895737 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-68068256-0454-4bbc-b0d1-b5b0a9e66e40 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:46.904871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-68068256-0454-4bbc-b0d1-b5b0a9e66e40 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1275 microversion: 2.1 time: 0.306886 Aug 29 20:34:46.917355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 114/226] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:46 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1275 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:47.344982 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-46b7e39d-1639-455b-9c81-afc1a6897abb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:47.346649 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-46b7e39d-1639-455b-9c81-afc1a6897abb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:47.357703 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-46b7e39d-1639-455b-9c81-afc1a6897abb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:47.358192 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-46b7e39d-1639-455b-9c81-afc1a6897abb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:47.358685 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-46b7e39d-1639-455b-9c81-afc1a6897abb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:47.359734 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-46b7e39d-1639-455b-9c81-afc1a6897abb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:47.373468 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-46b7e39d-1639-455b-9c81-afc1a6897abb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:47.373990 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-46b7e39d-1639-455b-9c81-afc1a6897abb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:47.935852 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-087e0fec-dea3-4050-8b0a-f8a117339d5b tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:47.936875 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-46b7e39d-1639-455b-9c81-afc1a6897abb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:47.937318 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-087e0fec-dea3-4050-8b0a-f8a117339d5b tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:47.948324 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-087e0fec-dea3-4050-8b0a-f8a117339d5b tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:47.961689 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-46b7e39d-1639-455b-9c81-afc1a6897abb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.620955 Aug 29 20:34:47.963406 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-087e0fec-dea3-4050-8b0a-f8a117339d5b tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:47.969052 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 113/227] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:47 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:47.969438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-087e0fec-dea3-4050-8b0a-f8a117339d5b tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:47.970544 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-087e0fec-dea3-4050-8b0a-f8a117339d5b tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:47.971077 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-087e0fec-dea3-4050-8b0a-f8a117339d5b tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:47.971507 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-087e0fec-dea3-4050-8b0a-f8a117339d5b tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:48.178941 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-087e0fec-dea3-4050-8b0a-f8a117339d5b tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:48.195390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-087e0fec-dea3-4050-8b0a-f8a117339d5b tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1273 microversion: 2.1 time: 0.264987 Aug 29 20:34:48.201872 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 115/228] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:47 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:48.996631 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-adad6f8f-dfb6-4dda-9ccf-1acb1c22bb1c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:48.996631 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-adad6f8f-dfb6-4dda-9ccf-1acb1c22bb1c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:49.010159 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-adad6f8f-dfb6-4dda-9ccf-1acb1c22bb1c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:49.010900 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-adad6f8f-dfb6-4dda-9ccf-1acb1c22bb1c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:49.011401 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-adad6f8f-dfb6-4dda-9ccf-1acb1c22bb1c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:49.015389 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-adad6f8f-dfb6-4dda-9ccf-1acb1c22bb1c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:49.022488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-adad6f8f-dfb6-4dda-9ccf-1acb1c22bb1c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:49.023259 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-adad6f8f-dfb6-4dda-9ccf-1acb1c22bb1c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:49.226526 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb5171c7-f99c-4be8-b2aa-d382deccfd78 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:49.227879 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb5171c7-f99c-4be8-b2aa-d382deccfd78 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:49.235920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5171c7-f99c-4be8-b2aa-d382deccfd78 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:49.236864 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5171c7-f99c-4be8-b2aa-d382deccfd78 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:49.237562 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5171c7-f99c-4be8-b2aa-d382deccfd78 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:49.238556 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5171c7-f99c-4be8-b2aa-d382deccfd78 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:49.239268 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5171c7-f99c-4be8-b2aa-d382deccfd78 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:49.239920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb5171c7-f99c-4be8-b2aa-d382deccfd78 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:49.406151 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-adad6f8f-dfb6-4dda-9ccf-1acb1c22bb1c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:49.421743 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-adad6f8f-dfb6-4dda-9ccf-1acb1c22bb1c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.435205 Aug 29 20:34:49.425055 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 114/229] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:48 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:49.559239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-eb5171c7-f99c-4be8-b2aa-d382deccfd78 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:49.586755 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb5171c7-f99c-4be8-b2aa-d382deccfd78 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1273 microversion: 2.1 time: 0.364007 Aug 29 20:34:49.605270 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 116/230] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:49 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1273 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:50.447904 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-31f03d2d-5267-419a-93b1-64792447d314 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:50.448689 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-31f03d2d-5267-419a-93b1-64792447d314 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:50.461511 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31f03d2d-5267-419a-93b1-64792447d314 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:50.470994 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31f03d2d-5267-419a-93b1-64792447d314 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:50.471701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31f03d2d-5267-419a-93b1-64792447d314 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:50.472547 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31f03d2d-5267-419a-93b1-64792447d314 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:50.473016 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31f03d2d-5267-419a-93b1-64792447d314 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:50.473448 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31f03d2d-5267-419a-93b1-64792447d314 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:50.614194 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-76c9640d-3084-4c7a-b335-a4e2fa4a75e2 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:50.615255 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-76c9640d-3084-4c7a-b335-a4e2fa4a75e2 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:50.682019 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76c9640d-3084-4c7a-b335-a4e2fa4a75e2 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:50.682852 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76c9640d-3084-4c7a-b335-a4e2fa4a75e2 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:50.683918 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76c9640d-3084-4c7a-b335-a4e2fa4a75e2 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:50.685493 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76c9640d-3084-4c7a-b335-a4e2fa4a75e2 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:50.686601 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76c9640d-3084-4c7a-b335-a4e2fa4a75e2 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:50.687651 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76c9640d-3084-4c7a-b335-a4e2fa4a75e2 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:51.285401 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-31f03d2d-5267-419a-93b1-64792447d314 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:51.333487 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-31f03d2d-5267-419a-93b1-64792447d314 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.889601 Aug 29 20:34:51.337794 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 115/231] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:50 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:51.370886 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1893875519", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0c2c5bd-a9a1-411b-a42c-01cbce56e13b"}], "security_groups": [{"name": "tempest-securitygroup--1640966560"}], "key_name": "tempest-keypair-12196286", "user_data": "}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:51.387745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=36 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:51.614393 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-76c9640d-3084-4c7a-b335-a4e2fa4a75e2 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:51.615816 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.network.neutron [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] validate_networks() for [('f0c2c5bd-a9a1-411b-a42c-01cbce56e13b', None, None, None, None, None)] {{(pid=127027) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:34:51.647618 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-76c9640d-3084-4c7a-b335-a4e2fa4a75e2 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1315 microversion: 2.1 time: 1.040210 Aug 29 20:34:51.648463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 117/232] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:50 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1315 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:52.386401 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2f37142a-c563-4159-9a76-3636fb37528d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:52.390059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2f37142a-c563-4159-9a76-3636fb37528d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:52.411390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:52.420244 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f37142a-c563-4159-9a76-3636fb37528d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:52.421063 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f37142a-c563-4159-9a76-3636fb37528d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:52.421521 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f37142a-c563-4159-9a76-3636fb37528d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:52.428357 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f37142a-c563-4159-9a76-3636fb37528d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:52.429860 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f37142a-c563-4159-9a76-3636fb37528d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:52.433932 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f37142a-c563-4159-9a76-3636fb37528d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:52.683718 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Flavor limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:34:52.684403 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Image limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:34:52.684685 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Flavor pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:34:52.685333 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Image pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:34:52.685844 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:34:52.713890 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:52.721825 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:52.722263 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:52.723387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:52.723845 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:52.724305 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:52.748593 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Getting quotas for project bf00868e84384ee59320184a5e1c46c8. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:34:52.756073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Getting quotas for user 068f28eb74e74650a2b80d29664109ae and project bf00868e84384ee59320184a5e1c46c8. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:34:52.775682 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Going to run 1 instances... {{(pid=127027) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:34:52.779345 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:34:52.871622 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-bc0e2e3e-ae86-4614-a2ac-4e4a40cc9bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.530053 Aug 29 20:34:52.872893 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 116/233] 10.222.0.18 () {62 vars in 1188 bytes} [Mon Aug 29 20:34:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1534 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 20:34:52.878710 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6651b939-712f-4e58-8065-e05cc0036402 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:52.879767 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6651b939-712f-4e58-8065-e05cc0036402 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:52.891669 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6651b939-712f-4e58-8065-e05cc0036402 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:52.891669 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6651b939-712f-4e58-8065-e05cc0036402 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:52.894786 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6651b939-712f-4e58-8065-e05cc0036402 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:52.896133 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6651b939-712f-4e58-8065-e05cc0036402 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:52.898465 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6651b939-712f-4e58-8065-e05cc0036402 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:52.899659 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6651b939-712f-4e58-8065-e05cc0036402 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:53.240294 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-2f37142a-c563-4159-9a76-3636fb37528d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:53.260819 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2f37142a-c563-4159-9a76-3636fb37528d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.888441 Aug 29 20:34:53.262545 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 118/234] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:52 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:53.276869 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d8220ee-2f67-410e-875c-7ac38851ab3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:53.287966 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9d8220ee-2f67-410e-875c-7ac38851ab3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:53.321478 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-6651b939-712f-4e58-8065-e05cc0036402 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:53.339670 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6651b939-712f-4e58-8065-e05cc0036402 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1315 microversion: 2.1 time: 0.463326 Aug 29 20:34:53.343537 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 117/235] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:52 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:53.551782 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d8220ee-2f67-410e-875c-7ac38851ab3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:53.598602 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d8220ee-2f67-410e-875c-7ac38851ab3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:53.608727 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-9d8220ee-2f67-410e-875c-7ac38851ab3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:53.615721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9d8220ee-2f67-410e-875c-7ac38851ab3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1280 microversion: 2.20 time: 0.351490 Aug 29 20:34:53.617759 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 119/236] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:53 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1280 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:54.293557 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-38ea1d21-1e5b-46f4-ac1b-1438794bf760 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:54.294179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-38ea1d21-1e5b-46f4-ac1b-1438794bf760 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:54.313303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-38ea1d21-1e5b-46f4-ac1b-1438794bf760 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:54.314065 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-38ea1d21-1e5b-46f4-ac1b-1438794bf760 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:54.314682 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-38ea1d21-1e5b-46f4-ac1b-1438794bf760 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:54.315400 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-38ea1d21-1e5b-46f4-ac1b-1438794bf760 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:54.316039 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-38ea1d21-1e5b-46f4-ac1b-1438794bf760 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:54.316623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-38ea1d21-1e5b-46f4-ac1b-1438794bf760 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:54.369268 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e6b7e889-f13b-4c8e-85b2-505b671b2be1 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:54.370733 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e6b7e889-f13b-4c8e-85b2-505b671b2be1 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:54.381004 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6b7e889-f13b-4c8e-85b2-505b671b2be1 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:54.381495 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6b7e889-f13b-4c8e-85b2-505b671b2be1 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:54.381931 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6b7e889-f13b-4c8e-85b2-505b671b2be1 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:54.382637 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6b7e889-f13b-4c8e-85b2-505b671b2be1 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:54.383084 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6b7e889-f13b-4c8e-85b2-505b671b2be1 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:54.383498 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e6b7e889-f13b-4c8e-85b2-505b671b2be1 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:54.833271 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-38ea1d21-1e5b-46f4-ac1b-1438794bf760 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:54.849437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-38ea1d21-1e5b-46f4-ac1b-1438794bf760 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.565928 Aug 29 20:34:54.854537 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 118/237] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:54 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:54.875700 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-d2911942-6126-42df-bc3c-b2bd61bb3647 req-5b40034a-5cc3-48f1-930e-82f939486a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa", "tag": "fe4ca0a1-17ee-4b99-8aa9-21db8d8a28a5"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:54.915019 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-d2911942-6126-42df-bc3c-b2bd61bb3647 req-5b40034a-5cc3-48f1-930e-82f939486a28 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:54.916651 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-d2911942-6126-42df-bc3c-b2bd61bb3647 req-5b40034a-5cc3-48f1-930e-82f939486a28 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:54.920984 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-d2911942-6126-42df-bc3c-b2bd61bb3647 req-5b40034a-5cc3-48f1-930e-82f939486a28 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:54.974329 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-d2911942-6126-42df-bc3c-b2bd61bb3647 req-5b40034a-5cc3-48f1-930e-82f939486a28 service nova] Creating event network-changed:fe4ca0a1-17ee-4b99-8aa9-21db8d8a28a5 for instance f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa on hv-cinder-85426 Aug 29 20:34:54.995020 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-d2911942-6126-42df-bc3c-b2bd61bb3647 req-5b40034a-5cc3-48f1-930e-82f939486a28 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135370 Aug 29 20:34:54.996503 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 119/238] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:34:55.004022 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-3b7a8345-41ea-4f09-989c-dfeef0e1ead9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:55.004751 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-3b7a8345-41ea-4f09-989c-dfeef0e1ead9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:55.012709 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3b7a8345-41ea-4f09-989c-dfeef0e1ead9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:55.013554 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3b7a8345-41ea-4f09-989c-dfeef0e1ead9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:55.014230 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3b7a8345-41ea-4f09-989c-dfeef0e1ead9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:55.015153 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3b7a8345-41ea-4f09-989c-dfeef0e1ead9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:55.016018 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3b7a8345-41ea-4f09-989c-dfeef0e1ead9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:55.016687 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3b7a8345-41ea-4f09-989c-dfeef0e1ead9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:55.330076 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e6b7e889-f13b-4c8e-85b2-505b671b2be1 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:55.344963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e6b7e889-f13b-4c8e-85b2-505b671b2be1 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1315 microversion: 2.1 time: 0.978800 Aug 29 20:34:55.346905 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 120/239] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:54 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1315 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:55.360138 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6688b723-7f21-4e48-99ae-c6a1ac226b8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:55.360983 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6688b723-7f21-4e48-99ae-c6a1ac226b8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:55.393948 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6688b723-7f21-4e48-99ae-c6a1ac226b8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:55.396052 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6688b723-7f21-4e48-99ae-c6a1ac226b8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:55.397691 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6688b723-7f21-4e48-99ae-c6a1ac226b8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:55.405640 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6688b723-7f21-4e48-99ae-c6a1ac226b8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:55.406576 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6688b723-7f21-4e48-99ae-c6a1ac226b8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:55.407662 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6688b723-7f21-4e48-99ae-c6a1ac226b8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:55.489104 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6688b723-7f21-4e48-99ae-c6a1ac226b8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/ips" status: 200 len: 146 microversion: 2.1 time: 0.138887 Aug 29 20:34:55.501134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 121/240] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 29 20:34:55 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/ips => generated 146 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:34:55.645749 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-3b7a8345-41ea-4f09-989c-dfeef0e1ead9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:55.665070 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-3b7a8345-41ea-4f09-989c-dfeef0e1ead9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:55.670196 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-3b7a8345-41ea-4f09-989c-dfeef0e1ead9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:55.680209 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-3b7a8345-41ea-4f09-989c-dfeef0e1ead9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1332 microversion: 2.20 time: 0.673942 Aug 29 20:34:55.680939 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 120/241] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:54 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1332 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:55.882204 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b0debed4-2af1-4dcd-81e8-0ca70b52b620 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:55.883124 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0debed4-2af1-4dcd-81e8-0ca70b52b620 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:55.907650 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0debed4-2af1-4dcd-81e8-0ca70b52b620 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:55.909031 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0debed4-2af1-4dcd-81e8-0ca70b52b620 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:55.911286 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0debed4-2af1-4dcd-81e8-0ca70b52b620 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:55.912839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0debed4-2af1-4dcd-81e8-0ca70b52b620 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:55.918803 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0debed4-2af1-4dcd-81e8-0ca70b52b620 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:55.924717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0debed4-2af1-4dcd-81e8-0ca70b52b620 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:56.367106 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-64d2118f-a4c1-4129-b9f2-a46df8239daf tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:56.368071 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-64d2118f-a4c1-4129-b9f2-a46df8239daf tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:56.381812 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-64d2118f-a4c1-4129-b9f2-a46df8239daf tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:56.399296 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-64d2118f-a4c1-4129-b9f2-a46df8239daf tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:56.402254 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-64d2118f-a4c1-4129-b9f2-a46df8239daf tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:56.403232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-64d2118f-a4c1-4129-b9f2-a46df8239daf tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:56.406817 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-64d2118f-a4c1-4129-b9f2-a46df8239daf tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:56.409048 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-64d2118f-a4c1-4129-b9f2-a46df8239daf tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:56.719191 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0debed4-2af1-4dcd-81e8-0ca70b52b620 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:56.737645 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b0debed4-2af1-4dcd-81e8-0ca70b52b620 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.862372 Aug 29 20:34:56.741082 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 122/242] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:55 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:56.749571 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a3ef2b98-3cc0-4fc7-9bd6-c4c65e25e4c7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:56.761276 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a3ef2b98-3cc0-4fc7-9bd6-c4c65e25e4c7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:56.788342 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3ef2b98-3cc0-4fc7-9bd6-c4c65e25e4c7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:56.796176 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3ef2b98-3cc0-4fc7-9bd6-c4c65e25e4c7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:56.803302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3ef2b98-3cc0-4fc7-9bd6-c4c65e25e4c7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:56.818833 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3ef2b98-3cc0-4fc7-9bd6-c4c65e25e4c7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:56.819359 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3ef2b98-3cc0-4fc7-9bd6-c4c65e25e4c7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:56.819807 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a3ef2b98-3cc0-4fc7-9bd6-c4c65e25e4c7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:57.224183 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-64d2118f-a4c1-4129-b9f2-a46df8239daf tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:57.252092 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-64d2118f-a4c1-4129-b9f2-a46df8239daf tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1315 microversion: 2.1 time: 0.889747 Aug 29 20:34:57.253154 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 121/243] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:56 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1315 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:57.320668 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a3ef2b98-3cc0-4fc7-9bd6-c4c65e25e4c7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:57.336579 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a3ef2b98-3cc0-4fc7-9bd6-c4c65e25e4c7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:57.340244 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a3ef2b98-3cc0-4fc7-9bd6-c4c65e25e4c7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:57.341439 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a3ef2b98-3cc0-4fc7-9bd6-c4c65e25e4c7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1338 microversion: 2.20 time: 0.599131 Aug 29 20:34:57.342287 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 123/244] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:56 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1338 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:34:57.773540 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7d5018d0-f664-41ba-af88-b9434faea496 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:57.774503 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7d5018d0-f664-41ba-af88-b9434faea496 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:57.791781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d5018d0-f664-41ba-af88-b9434faea496 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:57.792904 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d5018d0-f664-41ba-af88-b9434faea496 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:57.793835 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d5018d0-f664-41ba-af88-b9434faea496 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:57.794799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d5018d0-f664-41ba-af88-b9434faea496 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:57.795530 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d5018d0-f664-41ba-af88-b9434faea496 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:57.796513 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d5018d0-f664-41ba-af88-b9434faea496 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:58.276797 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7d4857a2-b4ed-4dbc-bfb8-d40845d5d616 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:58.277709 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7d4857a2-b4ed-4dbc-bfb8-d40845d5d616 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:58.298236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d4857a2-b4ed-4dbc-bfb8-d40845d5d616 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:58.298724 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d4857a2-b4ed-4dbc-bfb8-d40845d5d616 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:58.300912 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d4857a2-b4ed-4dbc-bfb8-d40845d5d616 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:58.301986 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d4857a2-b4ed-4dbc-bfb8-d40845d5d616 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:58.302586 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d4857a2-b4ed-4dbc-bfb8-d40845d5d616 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:58.303027 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d4857a2-b4ed-4dbc-bfb8-d40845d5d616 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:58.317766 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7d5018d0-f664-41ba-af88-b9434faea496 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:58.353781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7d5018d0-f664-41ba-af88-b9434faea496 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.579772 Aug 29 20:34:58.356726 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 122/245] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:57 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:34:58.378753 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2aad8a74-d75e-43de-bea9-479ca460822c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:58.379676 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2aad8a74-d75e-43de-bea9-479ca460822c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:58.396687 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2aad8a74-d75e-43de-bea9-479ca460822c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:58.402427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2aad8a74-d75e-43de-bea9-479ca460822c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:58.407742 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2aad8a74-d75e-43de-bea9-479ca460822c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:58.412582 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2aad8a74-d75e-43de-bea9-479ca460822c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:58.417476 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2aad8a74-d75e-43de-bea9-479ca460822c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:58.417974 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2aad8a74-d75e-43de-bea9-479ca460822c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:58.910034 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2aad8a74-d75e-43de-bea9-479ca460822c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:58.926936 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2aad8a74-d75e-43de-bea9-479ca460822c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:58.931212 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2aad8a74-d75e-43de-bea9-479ca460822c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:58.956289 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2aad8a74-d75e-43de-bea9-479ca460822c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1406 microversion: 2.20 time: 0.564051 Aug 29 20:34:58.958007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 123/246] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:58 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1406 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:34:58.973793 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-32110b5f-de74-43c6-9575-7061574ba57b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3af6f23-1c86-4f18-871f-a5cf7b2ca270"}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:34:58.980638 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-32110b5f-de74-43c6-9575-7061574ba57b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:58.993737 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-32110b5f-de74-43c6-9575-7061574ba57b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:59.007680 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-32110b5f-de74-43c6-9575-7061574ba57b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:59.008323 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-32110b5f-de74-43c6-9575-7061574ba57b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:59.020836 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-32110b5f-de74-43c6-9575-7061574ba57b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:59.021453 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-32110b5f-de74-43c6-9575-7061574ba57b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:59.021942 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-32110b5f-de74-43c6-9575-7061574ba57b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:59.658935 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7d4857a2-b4ed-4dbc-bfb8-d40845d5d616 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:34:59.659436 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-32110b5f-de74-43c6-9575-7061574ba57b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "POST /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699656 Aug 29 20:34:59.663147 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 124/247] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 29 20:34:58 2022] POST /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/os-volume_attachments => generated 194 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:34:59.677765 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-0254ad9a-a2b9-4441-8dfe-0caf7a55a056 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:59.679922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-0254ad9a-a2b9-4441-8dfe-0caf7a55a056 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:34:59.700356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0254ad9a-a2b9-4441-8dfe-0caf7a55a056 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:59.701157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0254ad9a-a2b9-4441-8dfe-0caf7a55a056 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:59.702613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0254ad9a-a2b9-4441-8dfe-0caf7a55a056 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:59.705382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0254ad9a-a2b9-4441-8dfe-0caf7a55a056 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:34:59.707822 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7d4857a2-b4ed-4dbc-bfb8-d40845d5d616 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1315 microversion: 2.1 time: 1.436094 Aug 29 20:34:59.708296 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0254ad9a-a2b9-4441-8dfe-0caf7a55a056 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:34:59.711071 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0254ad9a-a2b9-4441-8dfe-0caf7a55a056 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:34:59.734627 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 124/248] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:58 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1315 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:34:59.735485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:59.986166 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6092bc24-168a-404c-b0fd-5a978692d2af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:34:59.986701 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6092bc24-168a-404c-b0fd-5a978692d2af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:00.003007 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:00.004834 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6092bc24-168a-404c-b0fd-5a978692d2af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:00.014472 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6092bc24-168a-404c-b0fd-5a978692d2af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:00.015438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6092bc24-168a-404c-b0fd-5a978692d2af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:00.017360 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6092bc24-168a-404c-b0fd-5a978692d2af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:00.020331 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6092bc24-168a-404c-b0fd-5a978692d2af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:00.024606 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6092bc24-168a-404c-b0fd-5a978692d2af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:01.198182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-0254ad9a-a2b9-4441-8dfe-0caf7a55a056 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:01.213247 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-0254ad9a-a2b9-4441-8dfe-0caf7a55a056 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 1.546879 Aug 29 20:35:01.217046 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 125/249] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:34:59 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:01.231172 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2d8c9819-212c-4b96-bf99-b42bec3bfbc4 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:01.233196 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2d8c9819-212c-4b96-bf99-b42bec3bfbc4 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:01.250723 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d8c9819-212c-4b96-bf99-b42bec3bfbc4 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:01.255679 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d8c9819-212c-4b96-bf99-b42bec3bfbc4 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:01.256314 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d8c9819-212c-4b96-bf99-b42bec3bfbc4 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:01.257374 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d8c9819-212c-4b96-bf99-b42bec3bfbc4 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:01.258071 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d8c9819-212c-4b96-bf99-b42bec3bfbc4 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:01.261571 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d8c9819-212c-4b96-bf99-b42bec3bfbc4 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:01.313596 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6092bc24-168a-404c-b0fd-5a978692d2af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:01.346650 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6092bc24-168a-404c-b0fd-5a978692d2af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:01.354962 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6092bc24-168a-404c-b0fd-5a978692d2af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:01.360333 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6092bc24-168a-404c-b0fd-5a978692d2af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1406 microversion: 2.20 time: 1.379954 Aug 29 20:35:01.386525 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 125/250] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:34:59 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1406 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:35:02.142000 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2d8c9819-212c-4b96-bf99-b42bec3bfbc4 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:02.152969 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2d8c9819-212c-4b96-bf99-b42bec3bfbc4 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1315 microversion: 2.1 time: 0.933976 Aug 29 20:35:02.157288 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 126/251] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:01 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1315 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:02.241176 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-129521bf-08aa-4617-9785-d85e6d804bbb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:02.241176 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-129521bf-08aa-4617-9785-d85e6d804bbb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:02.260814 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-129521bf-08aa-4617-9785-d85e6d804bbb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:02.261590 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-129521bf-08aa-4617-9785-d85e6d804bbb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:02.265584 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-129521bf-08aa-4617-9785-d85e6d804bbb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:02.268734 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-129521bf-08aa-4617-9785-d85e6d804bbb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:02.269756 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-129521bf-08aa-4617-9785-d85e6d804bbb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:02.272432 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-129521bf-08aa-4617-9785-d85e6d804bbb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:02.394912 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-773e6ace-4fc0-4f67-9736-7a0d472d5c6a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:02.395745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-773e6ace-4fc0-4f67-9736-7a0d472d5c6a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:02.418719 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-773e6ace-4fc0-4f67-9736-7a0d472d5c6a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:02.418950 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-773e6ace-4fc0-4f67-9736-7a0d472d5c6a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:02.419362 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-773e6ace-4fc0-4f67-9736-7a0d472d5c6a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:02.420133 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-773e6ace-4fc0-4f67-9736-7a0d472d5c6a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:02.420592 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-773e6ace-4fc0-4f67-9736-7a0d472d5c6a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:02.432777 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-773e6ace-4fc0-4f67-9736-7a0d472d5c6a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:02.732373 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:02.770243 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=8 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:02.955996 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-129521bf-08aa-4617-9785-d85e6d804bbb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:02.970820 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-129521bf-08aa-4617-9785-d85e6d804bbb tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1502 microversion: 2.1 time: 0.736798 Aug 29 20:35:02.974108 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 126/252] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:02 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1502 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:03.027121 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-977beac9-91c7-40e6-9c47-927126cf0490 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27c782f5-89ab-4a95-9b67-84515ad88419"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:03.053230 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-977beac9-91c7-40e6-9c47-927126cf0490 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:03.097853 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-977beac9-91c7-40e6-9c47-927126cf0490 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:03.098355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-977beac9-91c7-40e6-9c47-927126cf0490 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:03.098796 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-977beac9-91c7-40e6-9c47-927126cf0490 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:03.099506 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-977beac9-91c7-40e6-9c47-927126cf0490 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:03.100086 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-977beac9-91c7-40e6-9c47-927126cf0490 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:03.100401 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-977beac9-91c7-40e6-9c47-927126cf0490 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:03.199210 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-977beac9-91c7-40e6-9c47-927126cf0490 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] HTTP exception thrown: Cannot 'attach_volume' instance 3db93852-3c79-43ac-8757-a41602e8bc53 while it is in vm_state rescued Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-977beac9-91c7-40e6-9c47-927126cf0490 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Request method failure captured: Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53/os-volume_attachments HTTP/1.1 Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 74 Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJ-rwdl0t1Aj5l-1bGTIJFL-ZTxxAqt4Npmzg5SfQigz7qhWcnlSTLYkJ-kvIBMd62ylFVXsavpDA3ppxN3UCTRp7GeXqktCRuMiz1cX_UUXVeNdK0pTwdrrdVjfKv0odW_eu3KVvvRhEFMqiP8_f7uh50xlMra8Bbpcs0GLuMPJ8k Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 8436d85d931a41cfa6d626c08ad82ef4 Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:35:03.211322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:35:03.213236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8436d85d931a41cfa6d626c08ad82ef4"}]}] Aug 29 20:35:03.213236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:35:03.213236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 8436d85d931a41cfa6d626c08ad82ef4 Aug 29 20:35:03.213236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:35:03.213236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-ServerRescueNegativeTestJSON-1627718934-project Aug 29 20:35:03.213236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:35:03.213236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:35:03.213236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 8fbc5bd64315421e97931402fb0e3a6a Aug 29 20:35:03.213236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1627718934-project Aug 29 20:35:03.213236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Aug 29 20:35:03.213236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {"volumeAttachment": {"volumeId": "27c782f5-89ab-4a95-9b67-84515ad88419"}} Aug 29 20:35:03.213236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Cannot 'attach_volume' instance 3db93852-3c79-43ac-8757-a41602e8bc53 while it is in vm_state rescued Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'server_id': '3db93852-3c79-43ac-8757-a41602e8bc53', 'body': {'volumeAttachment': {'volumeId': '27c782f5-89ab-4a95-9b67-84515ad88419'}}} Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3db93852-3c79-43ac-8757-a41602e8bc53 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:35:03.214402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3db93852-3c79-43ac-8757-a41602e8bc53 while it is in vm_state rescued Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:03.216367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:03.217747 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:35:03.217747 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:35:03.217747 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3db93852-3c79-43ac-8757-a41602e8bc53 while it is in vm_state rescued Aug 29 20:35:03.217747 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:03.219500 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-977beac9-91c7-40e6-9c47-927126cf0490 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Returning 409 to user: Cannot 'attach_volume' instance 3db93852-3c79-43ac-8757-a41602e8bc53 while it is in vm_state rescued {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:35:03.220611 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-977beac9-91c7-40e6-9c47-927126cf0490 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "POST /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.217132 Aug 29 20:35:03.221460 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 127/253] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 29 20:35:03 2022] POST /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53/os-volume_attachments => generated 152 bytes in 219 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 20:35:03.231250 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-09178608-fea3-4c11-956f-6fa15b8570f3 req-0ca6b2e9-0669-4c8f-bba4-6c3d650519f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95026449-87b2-4f37-bfd3-554df7e6a037", "tag": "87154a2a-cc60-4d5c-bce5-20690a774470"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:03.264869 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-09178608-fea3-4c11-956f-6fa15b8570f3 req-0ca6b2e9-0669-4c8f-bba4-6c3d650519f7 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:03.265646 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-09178608-fea3-4c11-956f-6fa15b8570f3 req-0ca6b2e9-0669-4c8f-bba4-6c3d650519f7 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:03.268865 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-09178608-fea3-4c11-956f-6fa15b8570f3 req-0ca6b2e9-0669-4c8f-bba4-6c3d650519f7 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:03.299854 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-09178608-fea3-4c11-956f-6fa15b8570f3 req-0ca6b2e9-0669-4c8f-bba4-6c3d650519f7 service nova] Creating event network-changed:87154a2a-cc60-4d5c-bce5-20690a774470 for instance 95026449-87b2-4f37-bfd3-554df7e6a037 on hv-cinder-85426 Aug 29 20:35:03.311148 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-09178608-fea3-4c11-956f-6fa15b8570f3 req-0ca6b2e9-0669-4c8f-bba4-6c3d650519f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088190 Aug 29 20:35:03.311955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 128/254] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:03.319770 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a64bc726-76f1-41a4-b757-2c04e14060dc tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:03.333982 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a64bc726-76f1-41a4-b757-2c04e14060dc tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:03.346564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a64bc726-76f1-41a4-b757-2c04e14060dc tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:03.347352 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a64bc726-76f1-41a4-b757-2c04e14060dc tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:03.348064 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a64bc726-76f1-41a4-b757-2c04e14060dc tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:03.348975 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a64bc726-76f1-41a4-b757-2c04e14060dc tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:03.349593 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a64bc726-76f1-41a4-b757-2c04e14060dc tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:03.350444 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a64bc726-76f1-41a4-b757-2c04e14060dc tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:03.566031 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=12 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:03.767346 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-773e6ace-4fc0-4f67-9736-7a0d472d5c6a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:03.776586 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a64bc726-76f1-41a4-b757-2c04e14060dc tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:03.786039 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-773e6ace-4fc0-4f67-9736-7a0d472d5c6a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:03.788799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-773e6ace-4fc0-4f67-9736-7a0d472d5c6a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:03.789993 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a64bc726-76f1-41a4-b757-2c04e14060dc tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1315 microversion: 2.1 time: 0.475171 Aug 29 20:35:03.791690 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 129/255] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:03 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:03.794099 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-773e6ace-4fc0-4f67-9736-7a0d472d5c6a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1406 microversion: 2.20 time: 1.403262 Aug 29 20:35:03.804275 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0bd99f3c-ac30-4912-b1c3-800a0b8bdb9f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:03.805133 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0bd99f3c-ac30-4912-b1c3-800a0b8bdb9f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:03.809454 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 127/256] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:02 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1406 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:35:03.828745 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bd99f3c-ac30-4912-b1c3-800a0b8bdb9f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:03.829269 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bd99f3c-ac30-4912-b1c3-800a0b8bdb9f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:03.829969 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bd99f3c-ac30-4912-b1c3-800a0b8bdb9f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:03.832879 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bd99f3c-ac30-4912-b1c3-800a0b8bdb9f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:03.833592 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bd99f3c-ac30-4912-b1c3-800a0b8bdb9f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:03.834210 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0bd99f3c-ac30-4912-b1c3-800a0b8bdb9f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:04.002655 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:04.050648 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0bd99f3c-ac30-4912-b1c3-800a0b8bdb9f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "POST /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53/action" status: 202 len: 0 microversion: 2.1 time: 0.255648 Aug 29 20:35:04.069620 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 130/257] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 29 20:35:03 2022] POST /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:35:04.071251 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6cd1b7bd-09e8-40bb-b489-7e58a1db67c0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:04.072388 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6cd1b7bd-09e8-40bb-b489-7e58a1db67c0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:04.083774 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6cd1b7bd-09e8-40bb-b489-7e58a1db67c0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:04.086966 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6cd1b7bd-09e8-40bb-b489-7e58a1db67c0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:04.088352 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6cd1b7bd-09e8-40bb-b489-7e58a1db67c0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:04.089389 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6cd1b7bd-09e8-40bb-b489-7e58a1db67c0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:04.091220 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6cd1b7bd-09e8-40bb-b489-7e58a1db67c0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:04.092989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6cd1b7bd-09e8-40bb-b489-7e58a1db67c0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:04.436768 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-6cd1b7bd-09e8-40bb-b489-7e58a1db67c0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:04.450770 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6cd1b7bd-09e8-40bb-b489-7e58a1db67c0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1510 microversion: 2.1 time: 0.391682 Aug 29 20:35:04.451409 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 128/258] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:04 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1510 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:04.824337 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-477d3e9c-d706-4e55-b494-91f54a105b47 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:04.825390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-477d3e9c-d706-4e55-b494-91f54a105b47 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:04.829103 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-719dd857-8b1b-4177-943a-fe6517172f7f tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:04.830049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-719dd857-8b1b-4177-943a-fe6517172f7f tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:04.842019 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-719dd857-8b1b-4177-943a-fe6517172f7f tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:04.847573 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-477d3e9c-d706-4e55-b494-91f54a105b47 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:04.848110 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-477d3e9c-d706-4e55-b494-91f54a105b47 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:04.848417 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-719dd857-8b1b-4177-943a-fe6517172f7f tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:04.849871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-477d3e9c-d706-4e55-b494-91f54a105b47 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:04.850375 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-719dd857-8b1b-4177-943a-fe6517172f7f tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:04.852241 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-477d3e9c-d706-4e55-b494-91f54a105b47 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:04.852751 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-477d3e9c-d706-4e55-b494-91f54a105b47 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:04.853132 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-719dd857-8b1b-4177-943a-fe6517172f7f tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:04.853272 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-477d3e9c-d706-4e55-b494-91f54a105b47 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:04.855682 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-719dd857-8b1b-4177-943a-fe6517172f7f tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:04.858153 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-719dd857-8b1b-4177-943a-fe6517172f7f tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:05.161740 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-719dd857-8b1b-4177-943a-fe6517172f7f tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:05.175252 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-719dd857-8b1b-4177-943a-fe6517172f7f tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1315 microversion: 2.1 time: 0.351112 Aug 29 20:35:05.178566 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 129/259] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:04 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:05.220307 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-477d3e9c-d706-4e55-b494-91f54a105b47 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:05.239021 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-477d3e9c-d706-4e55-b494-91f54a105b47 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:05.240550 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-477d3e9c-d706-4e55-b494-91f54a105b47 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:05.242016 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-477d3e9c-d706-4e55-b494-91f54a105b47 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1406 microversion: 2.20 time: 0.423959 Aug 29 20:35:05.245057 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 131/260] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:04 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1406 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:35:05.475414 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9c2b3a83-1926-4618-9076-987efe763275 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:05.476214 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9c2b3a83-1926-4618-9076-987efe763275 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:05.505168 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c2b3a83-1926-4618-9076-987efe763275 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:05.505690 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c2b3a83-1926-4618-9076-987efe763275 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:05.506130 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c2b3a83-1926-4618-9076-987efe763275 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:05.506844 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c2b3a83-1926-4618-9076-987efe763275 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:05.507300 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c2b3a83-1926-4618-9076-987efe763275 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:05.507719 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c2b3a83-1926-4618-9076-987efe763275 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:05.859041 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-7d401515-4685-4e20-9c79-07aa2c0797f4 req-19936907-74f2-41b3-bb65-093ce49b4eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa", "name": "network-vif-plugged", "status": "completed", "tag": "fe4ca0a1-17ee-4b99-8aa9-21db8d8a28a5"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:05.920622 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7d401515-4685-4e20-9c79-07aa2c0797f4 req-19936907-74f2-41b3-bb65-093ce49b4eda service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:05.924578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7d401515-4685-4e20-9c79-07aa2c0797f4 req-19936907-74f2-41b3-bb65-093ce49b4eda service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:05.926302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-7d401515-4685-4e20-9c79-07aa2c0797f4 req-19936907-74f2-41b3-bb65-093ce49b4eda service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:05.976738 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-7d401515-4685-4e20-9c79-07aa2c0797f4 req-19936907-74f2-41b3-bb65-093ce49b4eda service nova] Creating event network-vif-plugged:fe4ca0a1-17ee-4b99-8aa9-21db8d8a28a5 for instance f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa on hv-cinder-85426 Aug 29 20:35:05.991168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-7d401515-4685-4e20-9c79-07aa2c0797f4 req-19936907-74f2-41b3-bb65-093ce49b4eda service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142929 Aug 29 20:35:05.993586 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 132/261] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:35:06.212244 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8c11bf9a-9809-4a45-8f42-b36555ad52ab tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:06.213521 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8c11bf9a-9809-4a45-8f42-b36555ad52ab tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:06.243811 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c11bf9a-9809-4a45-8f42-b36555ad52ab tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:06.250919 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c11bf9a-9809-4a45-8f42-b36555ad52ab tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:06.254030 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c11bf9a-9809-4a45-8f42-b36555ad52ab tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:06.255211 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c11bf9a-9809-4a45-8f42-b36555ad52ab tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:06.255851 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c11bf9a-9809-4a45-8f42-b36555ad52ab tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:06.258082 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c11bf9a-9809-4a45-8f42-b36555ad52ab tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:06.383102 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9c2b3a83-1926-4618-9076-987efe763275 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:06.401603 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9c2b3a83-1926-4618-9076-987efe763275 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1510 microversion: 2.1 time: 0.931896 Aug 29 20:35:06.402205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 130/262] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:05 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1510 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:06.413695 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d184c4fc-6c53-4297-a9ec-91614f94cf84 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:06.428907 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d184c4fc-6c53-4297-a9ec-91614f94cf84 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:06.452980 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d184c4fc-6c53-4297-a9ec-91614f94cf84 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:06.453506 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d184c4fc-6c53-4297-a9ec-91614f94cf84 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:06.453938 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d184c4fc-6c53-4297-a9ec-91614f94cf84 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:06.454668 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d184c4fc-6c53-4297-a9ec-91614f94cf84 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:06.455124 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d184c4fc-6c53-4297-a9ec-91614f94cf84 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:06.466484 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d184c4fc-6c53-4297-a9ec-91614f94cf84 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:06.932987 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d184c4fc-6c53-4297-a9ec-91614f94cf84 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:06.951393 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d184c4fc-6c53-4297-a9ec-91614f94cf84 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:06.960580 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d184c4fc-6c53-4297-a9ec-91614f94cf84 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:06.965357 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d184c4fc-6c53-4297-a9ec-91614f94cf84 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1406 microversion: 2.20 time: 0.555068 Aug 29 20:35:06.965965 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 131/263] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:06 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1406 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:35:07.066123 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ea8e614c-b05d-4a26-8a3f-cf5cef19ee9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:07.089523 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ea8e614c-b05d-4a26-8a3f-cf5cef19ee9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:07.090265 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ea8e614c-b05d-4a26-8a3f-cf5cef19ee9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:07.091582 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ea8e614c-b05d-4a26-8a3f-cf5cef19ee9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:07.236394 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ea8e614c-b05d-4a26-8a3f-cf5cef19ee9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Going to try to stop instance {{(pid=127027) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 20:35:07.359349 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ea8e614c-b05d-4a26-8a3f-cf5cef19ee9d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "POST /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/action" status: 202 len: 0 microversion: 2.1 time: 0.297207 Aug 29 20:35:07.379831 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 132/264] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 29 20:35:07 2022] POST /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:35:07.403430 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-465870b5-6aed-4a45-966e-af107609c221 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:07.405041 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-465870b5-6aed-4a45-966e-af107609c221 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:07.424982 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-465870b5-6aed-4a45-966e-af107609c221 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:07.424982 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-465870b5-6aed-4a45-966e-af107609c221 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:07.425680 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-465870b5-6aed-4a45-966e-af107609c221 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:07.429378 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-465870b5-6aed-4a45-966e-af107609c221 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:07.432555 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-465870b5-6aed-4a45-966e-af107609c221 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:07.433600 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-465870b5-6aed-4a45-966e-af107609c221 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:07.659445 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8c11bf9a-9809-4a45-8f42-b36555ad52ab tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:07.691665 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8c11bf9a-9809-4a45-8f42-b36555ad52ab tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1315 microversion: 2.1 time: 1.485461 Aug 29 20:35:07.700244 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 133/265] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:06 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1315 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:07.723551 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-161acce5-7d35-42b1-a9f4-fc8d4a54ac35 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:07.724533 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-161acce5-7d35-42b1-a9f4-fc8d4a54ac35 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:07.743805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-161acce5-7d35-42b1-a9f4-fc8d4a54ac35 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:07.751690 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-161acce5-7d35-42b1-a9f4-fc8d4a54ac35 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:07.752412 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-161acce5-7d35-42b1-a9f4-fc8d4a54ac35 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:07.753256 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-161acce5-7d35-42b1-a9f4-fc8d4a54ac35 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:07.753810 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-161acce5-7d35-42b1-a9f4-fc8d4a54ac35 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:07.754348 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-161acce5-7d35-42b1-a9f4-fc8d4a54ac35 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:07.782613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-465870b5-6aed-4a45-966e-af107609c221 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:07.791889 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-465870b5-6aed-4a45-966e-af107609c221 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1723 microversion: 2.1 time: 0.406713 Aug 29 20:35:07.797963 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 133/266] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:07 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1723 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:07.808002 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1524854750", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "networks": [{"uuid": "03168a32-5f0e-4f8c-b2be-a70299b1ceb4"}]}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:07.950418 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.network.neutron [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] validate_networks() for [('03168a32-5f0e-4f8c-b2be-a70299b1ceb4', None, None, None, None, None)] {{(pid=127027) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:35:08.351734 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-161acce5-7d35-42b1-a9f4-fc8d4a54ac35 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:08.360220 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-161acce5-7d35-42b1-a9f4-fc8d4a54ac35 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1510 microversion: 2.1 time: 0.658451 Aug 29 20:35:08.363734 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 134/267] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:07 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1510 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:08.371673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-76239ef6-341e-42b2-8c1c-014e8c5421b8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:08.372693 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-76239ef6-341e-42b2-8c1c-014e8c5421b8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:08.380243 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76239ef6-341e-42b2-8c1c-014e8c5421b8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:08.381336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76239ef6-341e-42b2-8c1c-014e8c5421b8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:08.382035 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76239ef6-341e-42b2-8c1c-014e8c5421b8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:08.383000 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76239ef6-341e-42b2-8c1c-014e8c5421b8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:08.383763 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76239ef6-341e-42b2-8c1c-014e8c5421b8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:08.384436 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-76239ef6-341e-42b2-8c1c-014e8c5421b8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:08.702035 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-76239ef6-341e-42b2-8c1c-014e8c5421b8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:08.715742 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-76239ef6-341e-42b2-8c1c-014e8c5421b8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:08.717601 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-76239ef6-341e-42b2-8c1c-014e8c5421b8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:08.719084 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-76239ef6-341e-42b2-8c1c-014e8c5421b8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1406 microversion: 2.20 time: 0.352098 Aug 29 20:35:08.720275 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 135/268] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:08 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:35:08.725071 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-66fcf252-834b-4862-8eaf-f828f34f6225 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:08.725945 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-66fcf252-834b-4862-8eaf-f828f34f6225 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:08.732951 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fcf252-834b-4862-8eaf-f828f34f6225 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:08.733695 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fcf252-834b-4862-8eaf-f828f34f6225 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:08.734343 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fcf252-834b-4862-8eaf-f828f34f6225 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:08.735646 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fcf252-834b-4862-8eaf-f828f34f6225 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:08.736429 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fcf252-834b-4862-8eaf-f828f34f6225 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:08.737183 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66fcf252-834b-4862-8eaf-f828f34f6225 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:08.913500 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-66fcf252-834b-4862-8eaf-f828f34f6225 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:08.922504 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-66fcf252-834b-4862-8eaf-f828f34f6225 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1315 microversion: 2.1 time: 0.200963 Aug 29 20:35:08.939839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 136/269] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:08 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:08.944909 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6d28d295-9de0-488a-88b9-8ee7b286ff16 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:08.945769 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6d28d295-9de0-488a-88b9-8ee7b286ff16 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:08.958720 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d28d295-9de0-488a-88b9-8ee7b286ff16 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:08.961406 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d28d295-9de0-488a-88b9-8ee7b286ff16 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:08.965576 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d28d295-9de0-488a-88b9-8ee7b286ff16 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:08.966517 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d28d295-9de0-488a-88b9-8ee7b286ff16 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:08.968277 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d28d295-9de0-488a-88b9-8ee7b286ff16 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:08.968883 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6d28d295-9de0-488a-88b9-8ee7b286ff16 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:08.992742 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Flavor limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:35:08.994022 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Image limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:35:08.994692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Flavor pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:35:08.995248 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Image pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:35:08.995670 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:35:09.023713 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:09.024242 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:09.038136 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:09.039157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:09.039644 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:09.040113 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:09.133412 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Getting quotas for project 1c85b91350b74daeab5ba89364b4578e. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:35:09.159479 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Getting quotas for user 93dd431edc40415295518d9d24fd94af and project 1c85b91350b74daeab5ba89364b4578e. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:35:09.191737 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Going to run 1 instances... {{(pid=127027) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:35:09.200418 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:35:09.320238 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-27a08076-f77d-4054-9539-5d32b6565bf8 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.521083 Aug 29 20:35:09.325321 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 134/270] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:35:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:35:09.341048 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-340340e8-5da8-4646-9555-05a362dc71b5 req-e906ac3e-781b-441d-ae88-f702c84ab668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95026449-87b2-4f37-bfd3-554df7e6a037", "name": "network-vif-plugged", "status": "completed", "tag": "87154a2a-cc60-4d5c-bce5-20690a774470"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:09.367386 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-340340e8-5da8-4646-9555-05a362dc71b5 req-e906ac3e-781b-441d-ae88-f702c84ab668 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:09.371271 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-340340e8-5da8-4646-9555-05a362dc71b5 req-e906ac3e-781b-441d-ae88-f702c84ab668 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:09.372193 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-340340e8-5da8-4646-9555-05a362dc71b5 req-e906ac3e-781b-441d-ae88-f702c84ab668 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:09.406160 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-340340e8-5da8-4646-9555-05a362dc71b5 req-e906ac3e-781b-441d-ae88-f702c84ab668 service nova] Creating event network-vif-plugged:87154a2a-cc60-4d5c-bce5-20690a774470 for instance 95026449-87b2-4f37-bfd3-554df7e6a037 on hv-cinder-85426 Aug 29 20:35:09.417047 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-340340e8-5da8-4646-9555-05a362dc71b5 req-e906ac3e-781b-441d-ae88-f702c84ab668 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088935 Aug 29 20:35:09.420569 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 135/271] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:09.427723 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8535a264-65df-4cd4-9d6d-f58f8117a689 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:09.429097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8535a264-65df-4cd4-9d6d-f58f8117a689 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:09.596240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8535a264-65df-4cd4-9d6d-f58f8117a689 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:09.618251 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8535a264-65df-4cd4-9d6d-f58f8117a689 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1214 microversion: 2.1 time: 0.194817 Aug 29 20:35:09.642783 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 136/272] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:09 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1214 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:09.652222 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2f5d54c3-baa4-4200-86a6-fcb7350ba43c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:09.653393 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2f5d54c3-baa4-4200-86a6-fcb7350ba43c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:09.661624 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f5d54c3-baa4-4200-86a6-fcb7350ba43c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:09.663035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f5d54c3-baa4-4200-86a6-fcb7350ba43c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:09.663677 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f5d54c3-baa4-4200-86a6-fcb7350ba43c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:09.665134 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f5d54c3-baa4-4200-86a6-fcb7350ba43c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:09.665779 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f5d54c3-baa4-4200-86a6-fcb7350ba43c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:09.667140 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f5d54c3-baa4-4200-86a6-fcb7350ba43c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:09.904532 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6d28d295-9de0-488a-88b9-8ee7b286ff16 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:09.928485 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6d28d295-9de0-488a-88b9-8ee7b286ff16 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1723 microversion: 2.1 time: 0.986062 Aug 29 20:35:09.931185 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 137/273] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:08 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1723 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:09.946267 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-92c4421d-35d7-443c-b103-030669af961f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:09.947697 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-92c4421d-35d7-443c-b103-030669af961f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:09.966137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92c4421d-35d7-443c-b103-030669af961f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:09.967292 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92c4421d-35d7-443c-b103-030669af961f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:09.968504 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92c4421d-35d7-443c-b103-030669af961f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:09.970019 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92c4421d-35d7-443c-b103-030669af961f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:09.971907 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92c4421d-35d7-443c-b103-030669af961f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:09.973668 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92c4421d-35d7-443c-b103-030669af961f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:10.292614 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2f5d54c3-baa4-4200-86a6-fcb7350ba43c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:10.302396 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2f5d54c3-baa4-4200-86a6-fcb7350ba43c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1510 microversion: 2.1 time: 0.658426 Aug 29 20:35:10.313699 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 137/274] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:09 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1510 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:10.325186 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1a8bd2ea-ac2a-4f4e-b235-40671b6f9fee tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:10.325796 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1a8bd2ea-ac2a-4f4e-b235-40671b6f9fee tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:10.332093 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1a8bd2ea-ac2a-4f4e-b235-40671b6f9fee tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:10.332577 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1a8bd2ea-ac2a-4f4e-b235-40671b6f9fee tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:10.333009 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1a8bd2ea-ac2a-4f4e-b235-40671b6f9fee tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:10.334327 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1a8bd2ea-ac2a-4f4e-b235-40671b6f9fee tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:10.335086 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1a8bd2ea-ac2a-4f4e-b235-40671b6f9fee tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:10.335659 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1a8bd2ea-ac2a-4f4e-b235-40671b6f9fee tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:10.388798 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-92c4421d-35d7-443c-b103-030669af961f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:10.403165 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-92c4421d-35d7-443c-b103-030669af961f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:10.404685 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-92c4421d-35d7-443c-b103-030669af961f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:10.411447 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-92c4421d-35d7-443c-b103-030669af961f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1406 microversion: 2.20 time: 0.476642 Aug 29 20:35:10.412185 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 138/275] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:09 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1406 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:35:10.649840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-597bb1ca-6879-47f5-a292-33c3c31ce307 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:10.652162 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-597bb1ca-6879-47f5-a292-33c3c31ce307 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:10.663810 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597bb1ca-6879-47f5-a292-33c3c31ce307 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:10.664586 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597bb1ca-6879-47f5-a292-33c3c31ce307 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:10.668086 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597bb1ca-6879-47f5-a292-33c3c31ce307 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:10.669107 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597bb1ca-6879-47f5-a292-33c3c31ce307 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:10.669870 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597bb1ca-6879-47f5-a292-33c3c31ce307 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:10.670479 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-597bb1ca-6879-47f5-a292-33c3c31ce307 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:10.819149 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-597bb1ca-6879-47f5-a292-33c3c31ce307 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:10.842046 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-597bb1ca-6879-47f5-a292-33c3c31ce307 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1218 microversion: 2.1 time: 0.199962 Aug 29 20:35:10.845419 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 139/276] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:10 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1218 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:10.958232 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-67a0cfbb-cbd2-4a2a-8cf6-835fb0961d20 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:10.960482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-67a0cfbb-cbd2-4a2a-8cf6-835fb0961d20 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:10.973892 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67a0cfbb-cbd2-4a2a-8cf6-835fb0961d20 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:10.977547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67a0cfbb-cbd2-4a2a-8cf6-835fb0961d20 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:10.980528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67a0cfbb-cbd2-4a2a-8cf6-835fb0961d20 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:10.984562 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67a0cfbb-cbd2-4a2a-8cf6-835fb0961d20 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:10.986187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67a0cfbb-cbd2-4a2a-8cf6-835fb0961d20 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:10.988537 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67a0cfbb-cbd2-4a2a-8cf6-835fb0961d20 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:11.011652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1a8bd2ea-ac2a-4f4e-b235-40671b6f9fee tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:11.028168 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1a8bd2ea-ac2a-4f4e-b235-40671b6f9fee tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1464 microversion: 2.1 time: 0.713244 Aug 29 20:35:11.029396 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 138/277] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:10 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1464 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:11.111417 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-aeb5b83d-9acb-42d8-a623-3b254d0ebf74 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:11.112354 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-aeb5b83d-9acb-42d8-a623-3b254d0ebf74 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:11.129769 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-aeb5b83d-9acb-42d8-a623-3b254d0ebf74 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:11.133308 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-aeb5b83d-9acb-42d8-a623-3b254d0ebf74 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:11.135923 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-aeb5b83d-9acb-42d8-a623-3b254d0ebf74 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:11.141597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-aeb5b83d-9acb-42d8-a623-3b254d0ebf74 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:11.145490 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-aeb5b83d-9acb-42d8-a623-3b254d0ebf74 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:11.146844 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-aeb5b83d-9acb-42d8-a623-3b254d0ebf74 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:11.241595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-aeb5b83d-9acb-42d8-a623-3b254d0ebf74 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Going to try to terminate instance {{(pid=127027) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:35:11.260965 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-67a0cfbb-cbd2-4a2a-8cf6-835fb0961d20 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:11.273098 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-67a0cfbb-cbd2-4a2a-8cf6-835fb0961d20 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1723 microversion: 2.1 time: 0.319212 Aug 29 20:35:11.279797 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 140/278] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:10 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:11.334145 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-13ed5cb9-9078-40f4-9c2e-a23afd9e1bac tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:11.334911 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-13ed5cb9-9078-40f4-9c2e-a23afd9e1bac tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:11.342401 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ed5cb9-9078-40f4-9c2e-a23afd9e1bac tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:11.343271 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ed5cb9-9078-40f4-9c2e-a23afd9e1bac tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:11.343990 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ed5cb9-9078-40f4-9c2e-a23afd9e1bac tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:11.344955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ed5cb9-9078-40f4-9c2e-a23afd9e1bac tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:11.345632 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ed5cb9-9078-40f4-9c2e-a23afd9e1bac tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:11.346262 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-13ed5cb9-9078-40f4-9c2e-a23afd9e1bac tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:11.512217 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-aeb5b83d-9acb-42d8-a623-3b254d0ebf74 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 204 len: 0 microversion: 2.1 time: 0.405887 Aug 29 20:35:11.512749 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 139/279] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:35:11 2022] DELETE /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:35:11.518050 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-731ee8a5-2f55-4396-910d-128e04878948 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:11.518761 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-731ee8a5-2f55-4396-910d-128e04878948 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:11.563984 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-731ee8a5-2f55-4396-910d-128e04878948 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:11.564493 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-731ee8a5-2f55-4396-910d-128e04878948 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:11.564930 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-731ee8a5-2f55-4396-910d-128e04878948 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:11.565649 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-731ee8a5-2f55-4396-910d-128e04878948 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:11.566100 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-731ee8a5-2f55-4396-910d-128e04878948 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:11.566521 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-731ee8a5-2f55-4396-910d-128e04878948 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:11.598967 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-13ed5cb9-9078-40f4-9c2e-a23afd9e1bac tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:11.610478 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-13ed5cb9-9078-40f4-9c2e-a23afd9e1bac tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1516 microversion: 2.1 time: 0.280145 Aug 29 20:35:11.616264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 141/280] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:11 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1516 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:11.638784 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3eedd3c8-b7cf-47a7-b90e-1870a0b43488 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:11.640689 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3eedd3c8-b7cf-47a7-b90e-1870a0b43488 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:11.665868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3eedd3c8-b7cf-47a7-b90e-1870a0b43488 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:11.666637 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3eedd3c8-b7cf-47a7-b90e-1870a0b43488 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:11.667667 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3eedd3c8-b7cf-47a7-b90e-1870a0b43488 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:11.668173 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3eedd3c8-b7cf-47a7-b90e-1870a0b43488 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:11.669534 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3eedd3c8-b7cf-47a7-b90e-1870a0b43488 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:11.670067 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3eedd3c8-b7cf-47a7-b90e-1870a0b43488 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:11.970658 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3eedd3c8-b7cf-47a7-b90e-1870a0b43488 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:11.983195 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3eedd3c8-b7cf-47a7-b90e-1870a0b43488 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1470 microversion: 2.1 time: 0.365467 Aug 29 20:35:11.985526 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 142/281] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:11 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1470 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:11.991055 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2bee864e-8637-4d4f-a546-0b6f60611521 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:11.993050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2bee864e-8637-4d4f-a546-0b6f60611521 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:12.011051 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bee864e-8637-4d4f-a546-0b6f60611521 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:12.012117 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bee864e-8637-4d4f-a546-0b6f60611521 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:12.013641 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bee864e-8637-4d4f-a546-0b6f60611521 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:12.018054 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bee864e-8637-4d4f-a546-0b6f60611521 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:12.021109 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bee864e-8637-4d4f-a546-0b6f60611521 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:12.022653 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2bee864e-8637-4d4f-a546-0b6f60611521 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:12.211883 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-2bee864e-8637-4d4f-a546-0b6f60611521 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:12.227399 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2bee864e-8637-4d4f-a546-0b6f60611521 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1210 microversion: 2.1 time: 0.234035 Aug 29 20:35:12.243048 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 143/282] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:11 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1210 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:12.301565 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-396525e1-50e8-43d6-8be9-ce3fcc386e8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:12.302443 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-396525e1-50e8-43d6-8be9-ce3fcc386e8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:12.315388 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-396525e1-50e8-43d6-8be9-ce3fcc386e8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:12.317102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-396525e1-50e8-43d6-8be9-ce3fcc386e8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:12.317642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-396525e1-50e8-43d6-8be9-ce3fcc386e8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:12.332604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-396525e1-50e8-43d6-8be9-ce3fcc386e8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:12.332604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-396525e1-50e8-43d6-8be9-ce3fcc386e8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:12.332604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-396525e1-50e8-43d6-8be9-ce3fcc386e8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:12.410638 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-731ee8a5-2f55-4396-910d-128e04878948 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:12.429368 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-731ee8a5-2f55-4396-910d-128e04878948 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:12.431652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-731ee8a5-2f55-4396-910d-128e04878948 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:12.434013 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-731ee8a5-2f55-4396-910d-128e04878948 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1406 microversion: 2.20 time: 0.920179 Aug 29 20:35:12.434824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 140/283] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:11 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1406 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:35:12.601395 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-396525e1-50e8-43d6-8be9-ce3fcc386e8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:12.615122 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-396525e1-50e8-43d6-8be9-ce3fcc386e8c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1723 microversion: 2.1 time: 0.317841 Aug 29 20:35:12.627978 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 144/284] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:12 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:13.034900 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-04026a7b-db33-4033-99af-cea0ae01dfed tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:13.036130 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-04026a7b-db33-4033-99af-cea0ae01dfed tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:13.055090 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-04026a7b-db33-4033-99af-cea0ae01dfed tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:13.055842 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-04026a7b-db33-4033-99af-cea0ae01dfed tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:13.057961 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-04026a7b-db33-4033-99af-cea0ae01dfed tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:13.059768 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-04026a7b-db33-4033-99af-cea0ae01dfed tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:13.074515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-04026a7b-db33-4033-99af-cea0ae01dfed tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:13.075127 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-04026a7b-db33-4033-99af-cea0ae01dfed tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:13.106794 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:13.264331 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2714e9ca-95b9-46f9-bcab-55136e8c83bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:13.265963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2714e9ca-95b9-46f9-bcab-55136e8c83bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:13.280835 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2714e9ca-95b9-46f9-bcab-55136e8c83bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:13.284019 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2714e9ca-95b9-46f9-bcab-55136e8c83bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:13.284672 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2714e9ca-95b9-46f9-bcab-55136e8c83bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:13.285677 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2714e9ca-95b9-46f9-bcab-55136e8c83bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:13.289977 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2714e9ca-95b9-46f9-bcab-55136e8c83bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:13.290656 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2714e9ca-95b9-46f9-bcab-55136e8c83bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:13.422774 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-04026a7b-db33-4033-99af-cea0ae01dfed tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:13.425294 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-2714e9ca-95b9-46f9-bcab-55136e8c83bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:13.437442 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-04026a7b-db33-4033-99af-cea0ae01dfed tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1470 microversion: 2.1 time: 0.411281 Aug 29 20:35:13.451751 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2714e9ca-95b9-46f9-bcab-55136e8c83bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1210 microversion: 2.1 time: 0.181187 Aug 29 20:35:13.452976 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 141/285] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:13 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1470 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:13.453236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 145/286] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:13 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1210 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:13.458734 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-346277c0-032b-49de-a848-d756a308685c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Action: 'create', calling method: .version_select at 0x7f486345c5e0>, body: {"keypair": {"name": "tempest-keypair-2146418515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9zWvjElxM3PtbgYq4yOfMBLIK78UNx/wBPsaj4tJGSxku3+wL0Iuc+m6PJP8G/IcxFmCBkv1kY+rh4B2pF5VOba3brzTf3Xppkes7lzD3zAImivWz1ar0P4KDthgL/zQ=="}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:13.482177 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c8dd1175-cf36-42ff-bc5d-efc678490227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:13.482177 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c8dd1175-cf36-42ff-bc5d-efc678490227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:13.493312 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8dd1175-cf36-42ff-bc5d-efc678490227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:13.493888 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8dd1175-cf36-42ff-bc5d-efc678490227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:13.494432 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8dd1175-cf36-42ff-bc5d-efc678490227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:13.495222 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8dd1175-cf36-42ff-bc5d-efc678490227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:13.495750 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8dd1175-cf36-42ff-bc5d-efc678490227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:13.496038 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-346277c0-032b-49de-a848-d756a308685c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Getting quotas for project 8436d85d931a41cfa6d626c08ad82ef4. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:35:13.496347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8dd1175-cf36-42ff-bc5d-efc678490227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:13.505032 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-346277c0-032b-49de-a848-d756a308685c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Getting quotas for user 8fbc5bd64315421e97931402fb0e3a6a and project 8436d85d931a41cfa6d626c08ad82ef4. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:35:13.550915 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:13.565680 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-346277c0-032b-49de-a848-d756a308685c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111112 Aug 29 20:35:13.566644 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 142/287] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 29 20:35:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:13.639072 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-37b2b65a-0e01-46b2-8cf3-3b4a3eb6ff1b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:13.639805 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-37b2b65a-0e01-46b2-8cf3-3b4a3eb6ff1b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:13.649708 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-37b2b65a-0e01-46b2-8cf3-3b4a3eb6ff1b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:13.661009 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-37b2b65a-0e01-46b2-8cf3-3b4a3eb6ff1b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:13.662479 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-37b2b65a-0e01-46b2-8cf3-3b4a3eb6ff1b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:13.663417 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-37b2b65a-0e01-46b2-8cf3-3b4a3eb6ff1b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:13.671452 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-37b2b65a-0e01-46b2-8cf3-3b4a3eb6ff1b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:13.672721 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-37b2b65a-0e01-46b2-8cf3-3b4a3eb6ff1b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:13.811326 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c8dd1175-cf36-42ff-bc5d-efc678490227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:13.827743 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c8dd1175-cf36-42ff-bc5d-efc678490227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:13.837933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c8dd1175-cf36-42ff-bc5d-efc678490227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:13.839183 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c8dd1175-cf36-42ff-bc5d-efc678490227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1406 microversion: 2.20 time: 0.381555 Aug 29 20:35:13.855050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 146/288] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:13 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:35:14.036977 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-37b2b65a-0e01-46b2-8cf3-3b4a3eb6ff1b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:14.058956 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-37b2b65a-0e01-46b2-8cf3-3b4a3eb6ff1b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1723 microversion: 2.1 time: 0.423850 Aug 29 20:35:14.060001 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 143/289] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:13 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:14.471366 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e39babca-91b0-4166-88bf-cf336d886afe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:14.471784 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e39babca-91b0-4166-88bf-cf336d886afe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:14.473491 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2c0ca714-a109-43ce-a557-376ee5c86c01 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:14.476519 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2c0ca714-a109-43ce-a557-376ee5c86c01 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:14.495733 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e39babca-91b0-4166-88bf-cf336d886afe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:14.499899 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e39babca-91b0-4166-88bf-cf336d886afe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:14.504743 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e39babca-91b0-4166-88bf-cf336d886afe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:14.506112 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c0ca714-a109-43ce-a557-376ee5c86c01 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:14.509048 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c0ca714-a109-43ce-a557-376ee5c86c01 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:14.510236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e39babca-91b0-4166-88bf-cf336d886afe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:14.510915 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e39babca-91b0-4166-88bf-cf336d886afe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:14.512945 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c0ca714-a109-43ce-a557-376ee5c86c01 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:14.514959 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e39babca-91b0-4166-88bf-cf336d886afe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:14.515914 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c0ca714-a109-43ce-a557-376ee5c86c01 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:14.524779 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c0ca714-a109-43ce-a557-376ee5c86c01 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:14.525230 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c0ca714-a109-43ce-a557-376ee5c86c01 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:14.637399 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:14.796493 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2c0ca714-a109-43ce-a557-376ee5c86c01 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:14.815605 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2c0ca714-a109-43ce-a557-376ee5c86c01 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1428 microversion: 2.1 time: 0.350010 Aug 29 20:35:14.816686 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e39babca-91b0-4166-88bf-cf336d886afe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:14.817356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 144/290] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:14 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1428 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:14.834542 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-436eec73-2908-48be-bff6-c7a6a686bbf5 req-9f171bcb-baff-4e8e-9b39-be1bfd90351b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa", "name": "network-vif-deleted", "tag": "fe4ca0a1-17ee-4b99-8aa9-21db8d8a28a5"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:14.844859 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e39babca-91b0-4166-88bf-cf336d886afe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1266 microversion: 2.1 time: 0.378948 Aug 29 20:35:14.848095 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 147/291] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:14 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1266 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:14.863756 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dbe87012-1860-4841-a3a2-56ff7e514d01 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:14.865014 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dbe87012-1860-4841-a3a2-56ff7e514d01 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:14.874314 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-436eec73-2908-48be-bff6-c7a6a686bbf5 req-9f171bcb-baff-4e8e-9b39-be1bfd90351b service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:14.874804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-436eec73-2908-48be-bff6-c7a6a686bbf5 req-9f171bcb-baff-4e8e-9b39-be1bfd90351b service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:14.875334 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-436eec73-2908-48be-bff6-c7a6a686bbf5 req-9f171bcb-baff-4e8e-9b39-be1bfd90351b service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:14.893446 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-436eec73-2908-48be-bff6-c7a6a686bbf5 req-9f171bcb-baff-4e8e-9b39-be1bfd90351b service nova] Creating event network-vif-deleted:fe4ca0a1-17ee-4b99-8aa9-21db8d8a28a5 for instance f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa on hv-cinder-85426 Aug 29 20:35:14.903694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe87012-1860-4841-a3a2-56ff7e514d01 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:14.907643 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-436eec73-2908-48be-bff6-c7a6a686bbf5 req-9f171bcb-baff-4e8e-9b39-be1bfd90351b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089023 Aug 29 20:35:14.911355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe87012-1860-4841-a3a2-56ff7e514d01 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:14.912121 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe87012-1860-4841-a3a2-56ff7e514d01 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:14.913121 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe87012-1860-4841-a3a2-56ff7e514d01 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:14.918591 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe87012-1860-4841-a3a2-56ff7e514d01 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:14.919462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dbe87012-1860-4841-a3a2-56ff7e514d01 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:14.928589 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 145/292] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:15.094380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-0fc8893f-b048-4437-9982-31ca5f8250fa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:15.095083 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-0fc8893f-b048-4437-9982-31ca5f8250fa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:15.102702 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0fc8893f-b048-4437-9982-31ca5f8250fa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:15.103576 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0fc8893f-b048-4437-9982-31ca5f8250fa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:15.104676 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0fc8893f-b048-4437-9982-31ca5f8250fa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:15.112687 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0fc8893f-b048-4437-9982-31ca5f8250fa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:15.113649 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0fc8893f-b048-4437-9982-31ca5f8250fa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:15.114859 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0fc8893f-b048-4437-9982-31ca5f8250fa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:15.327879 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-dbe87012-1860-4841-a3a2-56ff7e514d01 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:15.354753 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-dbe87012-1860-4841-a3a2-56ff7e514d01 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:15.362998 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-dbe87012-1860-4841-a3a2-56ff7e514d01 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:15.364964 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dbe87012-1860-4841-a3a2-56ff7e514d01 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1406 microversion: 2.20 time: 0.505382 Aug 29 20:35:15.366069 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 148/293] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:14 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1406 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:35:15.383897 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-0fc8893f-b048-4437-9982-31ca5f8250fa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:15.395482 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-0fc8893f-b048-4437-9982-31ca5f8250fa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1723 microversion: 2.1 time: 0.305114 Aug 29 20:35:15.414451 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 146/294] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:15 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:15.839333 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1df931d4-28a0-4896-a8ef-388a99101547 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:15.840782 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1df931d4-28a0-4896-a8ef-388a99101547 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:15.851900 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df931d4-28a0-4896-a8ef-388a99101547 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:15.854806 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df931d4-28a0-4896-a8ef-388a99101547 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:15.856980 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df931d4-28a0-4896-a8ef-388a99101547 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:15.858749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df931d4-28a0-4896-a8ef-388a99101547 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:15.859676 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df931d4-28a0-4896-a8ef-388a99101547 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:15.862183 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df931d4-28a0-4896-a8ef-388a99101547 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:15.877539 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a4a7215c-a009-473d-b1fe-c46c04631b2c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:15.879605 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a4a7215c-a009-473d-b1fe-c46c04631b2c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:15.901568 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a4a7215c-a009-473d-b1fe-c46c04631b2c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:15.914928 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a4a7215c-a009-473d-b1fe-c46c04631b2c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:15.915768 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a4a7215c-a009-473d-b1fe-c46c04631b2c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:15.916861 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a4a7215c-a009-473d-b1fe-c46c04631b2c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:15.917557 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a4a7215c-a009-473d-b1fe-c46c04631b2c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:15.918378 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a4a7215c-a009-473d-b1fe-c46c04631b2c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:15.972538 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df931d4-28a0-4896-a8ef-388a99101547 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:15.973071 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df931d4-28a0-4896-a8ef-388a99101547 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:15.973683 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1df931d4-28a0-4896-a8ef-388a99101547 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:15.974166 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-1df931d4-28a0-4896-a8ef-388a99101547 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lazy-loading 'fault' on Instance uuid f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:35:16.081459 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1df931d4-28a0-4896-a8ef-388a99101547 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39abe902a6534e80affc78acafc0ab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4de197062eb48adb3f8af1a1f8e958c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:16.094401 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1df931d4-28a0-4896-a8ef-388a99101547 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 200 len: 1305 microversion: 2.1 time: 0.258692 Aug 29 20:35:16.096395 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 149/295] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:15 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 1305 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:16.107419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a4a7215c-a009-473d-b1fe-c46c04631b2c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:16.118117 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a4a7215c-a009-473d-b1fe-c46c04631b2c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1272 microversion: 2.1 time: 0.248309 Aug 29 20:35:16.133527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 147/296] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:15 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:16.394930 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a83077b6-71d5-47c8-8b21-4ee272880f4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:16.396132 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a83077b6-71d5-47c8-8b21-4ee272880f4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:16.414487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a83077b6-71d5-47c8-8b21-4ee272880f4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:16.415076 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a83077b6-71d5-47c8-8b21-4ee272880f4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:16.415537 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a83077b6-71d5-47c8-8b21-4ee272880f4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:16.417922 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a83077b6-71d5-47c8-8b21-4ee272880f4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:16.419313 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a83077b6-71d5-47c8-8b21-4ee272880f4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:16.420013 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a83077b6-71d5-47c8-8b21-4ee272880f4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:16.422391 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7399b57f-61f3-490e-a037-502b7039ab7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:16.423014 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7399b57f-61f3-490e-a037-502b7039ab7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:16.435958 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7399b57f-61f3-490e-a037-502b7039ab7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:16.436452 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7399b57f-61f3-490e-a037-502b7039ab7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:16.436888 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7399b57f-61f3-490e-a037-502b7039ab7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:16.437599 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7399b57f-61f3-490e-a037-502b7039ab7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:16.438051 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7399b57f-61f3-490e-a037-502b7039ab7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:16.438463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7399b57f-61f3-490e-a037-502b7039ab7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:17.099190 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a83077b6-71d5-47c8-8b21-4ee272880f4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:17.124289 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a83077b6-71d5-47c8-8b21-4ee272880f4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:17.126002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a83077b6-71d5-47c8-8b21-4ee272880f4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:17.127222 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a83077b6-71d5-47c8-8b21-4ee272880f4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1597 microversion: 2.20 time: 0.740136 Aug 29 20:35:17.127781 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 150/297] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:35:16 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1597 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:35:17.149182 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2b8dfe33-a3ea-4fc4-a899-cc61e5a9ba67 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:17.150511 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2b8dfe33-a3ea-4fc4-a899-cc61e5a9ba67 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] [instance: f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:17.163492 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b8dfe33-a3ea-4fc4-a899-cc61e5a9ba67 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:17.164298 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b8dfe33-a3ea-4fc4-a899-cc61e5a9ba67 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:17.168631 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b8dfe33-a3ea-4fc4-a899-cc61e5a9ba67 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:17.169778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b8dfe33-a3ea-4fc4-a899-cc61e5a9ba67 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:17.170392 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b8dfe33-a3ea-4fc4-a899-cc61e5a9ba67 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:17.170974 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2b8dfe33-a3ea-4fc4-a899-cc61e5a9ba67 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:17.199924 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-2b8dfe33-a3ea-4fc4-a899-cc61e5a9ba67 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] HTTP exception thrown: Instance f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa could not be found. Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2b8dfe33-a3ea-4fc4-a899-cc61e5a9ba67 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Request method failure captured: Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa HTTP/1.1 Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSLdPJZmMuEBUjSh9XcOfFs54f4N8-c7fkKWeCxkLq35Do2iXJT-Dbt5DkB91dZrP6Okx5mbj2hf1O46QO2diiE2tp3hHbr2LOTgdFPDgr86l9ae1coH_T114CixS0CFNdCR4zb1S_vvhNPVR41kbQyFDMTvf_Mjpv5yoxHZnpFd64Q Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: e4de197062eb48adb3f8af1a1f8e958c Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesNegativeTest-2118753920 Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:35:17.204302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:35:17.205910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e4de197062eb48adb3f8af1a1f8e958c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e4de197062eb48adb3f8af1a1f8e958c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e4de197062eb48adb3f8af1a1f8e958c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e4de197062eb48adb3f8af1a1f8e958c"}]}] Aug 29 20:35:17.205910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-VolumesNegativeTest-2118753920 Aug 29 20:35:17.205910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: e4de197062eb48adb3f8af1a1f8e958c Aug 29 20:35:17.205910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesNegativeTest-2118753920 Aug 29 20:35:17.205910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-VolumesNegativeTest-2118753920-project Aug 29 20:35:17.205910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:35:17.205910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:35:17.205910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 39abe902a6534e80affc78acafc0ab31 Aug 29 20:35:17.205910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-VolumesNegativeTest-2118753920-project Aug 29 20:35:17.205910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:35:17.205910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa could not be found. Aug 29 20:35:17.205910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': 'f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa'} Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa could not be found. Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:35:17.207187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa could not be found. Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa could not be found. Aug 29 20:35:17.214102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:17.215364 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2b8dfe33-a3ea-4fc4-a899-cc61e5a9ba67 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] Returning 404 to user: Instance f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:35:17.215364 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2b8dfe33-a3ea-4fc4-a899-cc61e5a9ba67 tempest-VolumesNegativeTest-2118753920 tempest-VolumesNegativeTest-2118753920-project] 10.222.0.18 "GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa" status: 404 len: 111 microversion: 2.1 time: 0.069568 Aug 29 20:35:17.223499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 151/298] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:17 2022] GET /compute/v2.1/servers/f3ab7e69-4d51-4dcd-a00d-6604b64ba2fa => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:35:17.235179 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-42499ce6-4f5f-42fd-acbd-78cacc52dd14 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:17.235887 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-42499ce6-4f5f-42fd-acbd-78cacc52dd14 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:17.253600 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42499ce6-4f5f-42fd-acbd-78cacc52dd14 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:17.254128 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42499ce6-4f5f-42fd-acbd-78cacc52dd14 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:17.255088 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42499ce6-4f5f-42fd-acbd-78cacc52dd14 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:17.255897 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42499ce6-4f5f-42fd-acbd-78cacc52dd14 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:17.256381 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42499ce6-4f5f-42fd-acbd-78cacc52dd14 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:17.256860 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-42499ce6-4f5f-42fd-acbd-78cacc52dd14 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:17.268810 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7399b57f-61f3-490e-a037-502b7039ab7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:17.285230 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7399b57f-61f3-490e-a037-502b7039ab7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1723 microversion: 2.1 time: 0.860848 Aug 29 20:35:17.289781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 148/299] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:16 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1723 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:17.306295 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-351c50e1-33d2-4719-9c15-e313d15acc50 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:17.309252 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-351c50e1-33d2-4719-9c15-e313d15acc50 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:17.327814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-351c50e1-33d2-4719-9c15-e313d15acc50 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:17.333510 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-351c50e1-33d2-4719-9c15-e313d15acc50 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:17.334880 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-351c50e1-33d2-4719-9c15-e313d15acc50 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:17.339079 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-351c50e1-33d2-4719-9c15-e313d15acc50 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:17.339923 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-351c50e1-33d2-4719-9c15-e313d15acc50 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:17.341804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-351c50e1-33d2-4719-9c15-e313d15acc50 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:17.497042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-351c50e1-33d2-4719-9c15-e313d15acc50 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.205898 Aug 29 20:35:17.497626 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 149/300] 10.222.0.18 () {60 vars in 1316 bytes} [Mon Aug 29 20:35:17 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/os-interface => generated 284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:35:17.641438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-42499ce6-4f5f-42fd-acbd-78cacc52dd14 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:17.649398 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-42499ce6-4f5f-42fd-acbd-78cacc52dd14 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1272 microversion: 2.1 time: 0.421367 Aug 29 20:35:17.659961 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 152/301] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:17 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1272 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:18.310951 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-75ecfa04-8f59-4b47-9725-d4d962e28ff1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:18.312140 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-75ecfa04-8f59-4b47-9725-d4d962e28ff1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:18.335354 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-75ecfa04-8f59-4b47-9725-d4d962e28ff1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:18.337536 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-75ecfa04-8f59-4b47-9725-d4d962e28ff1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:18.340545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-75ecfa04-8f59-4b47-9725-d4d962e28ff1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:18.345597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-75ecfa04-8f59-4b47-9725-d4d962e28ff1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:18.350150 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-75ecfa04-8f59-4b47-9725-d4d962e28ff1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:18.350999 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-75ecfa04-8f59-4b47-9725-d4d962e28ff1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:18.646271 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-168120947", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9aeb874f-5dc0-4462-96f6-c696d1a7b371"}], "security_groups": [{"name": "tempest-securitygroup--511836088"}], "key_name": "tempest-keypair-2146418515", "user_data": "}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:19.000454 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-75ecfa04-8f59-4b47-9725-d4d962e28ff1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:19.020792 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-75ecfa04-8f59-4b47-9725-d4d962e28ff1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1723 microversion: 2.1 time: 0.714514 Aug 29 20:35:19.022577 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 150/302] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:18 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1723 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:19.036508 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-537bda5b-d991-44a9-9729-edafb3005872 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:19.037535 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-537bda5b-d991-44a9-9729-edafb3005872 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:19.051294 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:19.059576 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-537bda5b-d991-44a9-9729-edafb3005872 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:19.060691 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-537bda5b-d991-44a9-9729-edafb3005872 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:19.061248 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-537bda5b-d991-44a9-9729-edafb3005872 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:19.064477 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-537bda5b-d991-44a9-9729-edafb3005872 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:19.065816 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-537bda5b-d991-44a9-9729-edafb3005872 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:19.069658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-537bda5b-d991-44a9-9729-edafb3005872 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:19.455485 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] validate_networks() for [('9aeb874f-5dc0-4462-96f6-c696d1a7b371', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:35:19.598762 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-537bda5b-d991-44a9-9729-edafb3005872 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:19.614627 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-537bda5b-d991-44a9-9729-edafb3005872 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1314 microversion: 2.1 time: 0.589750 Aug 29 20:35:19.617466 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 151/303] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:19 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:20.066039 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-18cd3e6c-7eee-494f-9b45-ea3f94932e08 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:20.067913 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-18cd3e6c-7eee-494f-9b45-ea3f94932e08 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:20.093458 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-18cd3e6c-7eee-494f-9b45-ea3f94932e08 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:20.100572 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-18cd3e6c-7eee-494f-9b45-ea3f94932e08 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:20.101768 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-18cd3e6c-7eee-494f-9b45-ea3f94932e08 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:20.102995 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-18cd3e6c-7eee-494f-9b45-ea3f94932e08 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:20.103905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-18cd3e6c-7eee-494f-9b45-ea3f94932e08 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:20.105090 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-18cd3e6c-7eee-494f-9b45-ea3f94932e08 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:20.431041 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-18cd3e6c-7eee-494f-9b45-ea3f94932e08 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:20.459622 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-18cd3e6c-7eee-494f-9b45-ea3f94932e08 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1723 microversion: 2.1 time: 0.420061 Aug 29 20:35:20.464433 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 152/304] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:20 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:20.642058 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-555c6790-4d55-4981-acb7-65304a2b5fc1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:20.643023 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-555c6790-4d55-4981-acb7-65304a2b5fc1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:20.676960 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-555c6790-4d55-4981-acb7-65304a2b5fc1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:20.677718 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-555c6790-4d55-4981-acb7-65304a2b5fc1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:20.696989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-555c6790-4d55-4981-acb7-65304a2b5fc1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:20.698302 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-555c6790-4d55-4981-acb7-65304a2b5fc1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:20.699550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-555c6790-4d55-4981-acb7-65304a2b5fc1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:20.699824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-555c6790-4d55-4981-acb7-65304a2b5fc1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:21.436323 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:35:21.436789 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:35:21.437190 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:35:21.437598 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:35:21.438006 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:35:21.457032 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:21.457546 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:21.458078 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:21.458683 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:21.459130 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:21.459552 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:21.532802 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Getting quotas for project 8436d85d931a41cfa6d626c08ad82ef4. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:35:21.544356 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Getting quotas for user 8fbc5bd64315421e97931402fb0e3a6a and project 8436d85d931a41cfa6d626c08ad82ef4. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:35:21.573027 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-555c6790-4d55-4981-acb7-65304a2b5fc1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:21.586656 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:35:21.603733 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-555c6790-4d55-4981-acb7-65304a2b5fc1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1314 microversion: 2.1 time: 0.969350 Aug 29 20:35:21.604870 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:35:21.623847 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 153/305] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:20 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1314 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:21.789022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7fe16e0e-f110-40ea-86ad-f74f1abdcaed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.144231 Aug 29 20:35:21.796337 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 153/306] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:35:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 3152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:35:21.802075 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b8bd9c53-7cf0-4865-ba37-b9fe54c4fc15 req-afdf12e8-d727-4f8b-95d9-f96cd4010c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95026449-87b2-4f37-bfd3-554df7e6a037", "tag": "87154a2a-cc60-4d5c-bce5-20690a774470"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:21.831998 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b8bd9c53-7cf0-4865-ba37-b9fe54c4fc15 req-afdf12e8-d727-4f8b-95d9-f96cd4010c07 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:21.836494 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b8bd9c53-7cf0-4865-ba37-b9fe54c4fc15 req-afdf12e8-d727-4f8b-95d9-f96cd4010c07 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:21.838151 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b8bd9c53-7cf0-4865-ba37-b9fe54c4fc15 req-afdf12e8-d727-4f8b-95d9-f96cd4010c07 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:21.862577 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b8bd9c53-7cf0-4865-ba37-b9fe54c4fc15 req-afdf12e8-d727-4f8b-95d9-f96cd4010c07 service nova] Creating event network-changed:87154a2a-cc60-4d5c-bce5-20690a774470 for instance 95026449-87b2-4f37-bfd3-554df7e6a037 on hv-cinder-85426 Aug 29 20:35:21.872785 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b8bd9c53-7cf0-4865-ba37-b9fe54c4fc15 req-afdf12e8-d727-4f8b-95d9-f96cd4010c07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078241 Aug 29 20:35:21.873380 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 154/307] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:21.892818 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28ad6e58-a7dd-441c-abfb-c7d5ec642958 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:21.895327 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-28ad6e58-a7dd-441c-abfb-c7d5ec642958 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:21.905261 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28ad6e58-a7dd-441c-abfb-c7d5ec642958 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:21.909079 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28ad6e58-a7dd-441c-abfb-c7d5ec642958 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:21.915533 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28ad6e58-a7dd-441c-abfb-c7d5ec642958 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:21.916912 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28ad6e58-a7dd-441c-abfb-c7d5ec642958 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:21.923274 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28ad6e58-a7dd-441c-abfb-c7d5ec642958 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:21.924454 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28ad6e58-a7dd-441c-abfb-c7d5ec642958 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:22.211256 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7217fee8-23a8-4fdd-a52d-404906f9e3e8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Action: 'create', calling method: .version_select at 0x7f4863596ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-959246705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa0DxCN3Qt1plOunoUaxJjZgUbY8Gnf1NqWDXytQFg6tj4AaGVl4yZeJbb0HX0/+wWsRsB5fAV/1emeNVyyTNoWorfjstdEJ3b9Gc/6tqa0D7wLhKyXUBfC2rRic5QznQ=="}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:22.248150 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-7217fee8-23a8-4fdd-a52d-404906f9e3e8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Getting quotas for project 2f93e5b4f52b4b8cac7e0336a44b33ba. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:35:22.260222 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-7217fee8-23a8-4fdd-a52d-404906f9e3e8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Getting quotas for user b93ff419d60043f0aab0c11a6abdaa38 and project 2f93e5b4f52b4b8cac7e0336a44b33ba. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:35:22.321679 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7217fee8-23a8-4fdd-a52d-404906f9e3e8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.710331 Aug 29 20:35:22.324990 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 154/308] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 29 20:35:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:22.335845 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b889e977-1c55-4210-8a71-4efe5aac33b3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:22.346626 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b889e977-1c55-4210-8a71-4efe5aac33b3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:22.603364 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b889e977-1c55-4210-8a71-4efe5aac33b3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:22.615001 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b889e977-1c55-4210-8a71-4efe5aac33b3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1245 microversion: 2.1 time: 0.288941 Aug 29 20:35:22.621240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 155/309] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:22 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1245 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:22.650049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-8e226476-45ba-4761-80ec-4dadfb9f10dc req-d51dc45a-ef3c-4dc7-94a5-67565560a4be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357d9e2a-8aa3-4f1b-92ab-0c4db7649f43", "tag": "1e1cfa6b-3a3e-4dfe-b010-9376ec5e6023"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:22.677868 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-8e226476-45ba-4761-80ec-4dadfb9f10dc req-d51dc45a-ef3c-4dc7-94a5-67565560a4be service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:22.681129 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-8e226476-45ba-4761-80ec-4dadfb9f10dc req-d51dc45a-ef3c-4dc7-94a5-67565560a4be service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:22.681748 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-8e226476-45ba-4761-80ec-4dadfb9f10dc req-d51dc45a-ef3c-4dc7-94a5-67565560a4be service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:22.713041 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-8e226476-45ba-4761-80ec-4dadfb9f10dc req-d51dc45a-ef3c-4dc7-94a5-67565560a4be service nova] Creating event network-changed:1e1cfa6b-3a3e-4dfe-b010-9376ec5e6023 for instance 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 on hv-cinder-85426 Aug 29 20:35:22.723861 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-8e226476-45ba-4761-80ec-4dadfb9f10dc req-d51dc45a-ef3c-4dc7-94a5-67565560a4be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092657 Aug 29 20:35:22.727274 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 156/310] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:22.742072 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4fe5bd72-93cf-465b-af2c-0929e4452e25 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:22.744783 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4fe5bd72-93cf-465b-af2c-0929e4452e25 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:22.769781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fe5bd72-93cf-465b-af2c-0929e4452e25 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:22.770555 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fe5bd72-93cf-465b-af2c-0929e4452e25 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:22.771786 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fe5bd72-93cf-465b-af2c-0929e4452e25 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:22.772803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fe5bd72-93cf-465b-af2c-0929e4452e25 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:22.774117 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fe5bd72-93cf-465b-af2c-0929e4452e25 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:22.774714 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fe5bd72-93cf-465b-af2c-0929e4452e25 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:22.843465 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-28ad6e58-a7dd-441c-abfb-c7d5ec642958 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:22.865376 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-28ad6e58-a7dd-441c-abfb-c7d5ec642958 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1723 microversion: 2.1 time: 0.986515 Aug 29 20:35:22.874050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 155/311] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:21 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1723 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:23.641762 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e5d976c0-db8f-4e4a-8ee2-40bf07f6fdb8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:23.642579 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e5d976c0-db8f-4e4a-8ee2-40bf07f6fdb8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:23.654052 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5d976c0-db8f-4e4a-8ee2-40bf07f6fdb8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:23.656143 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5d976c0-db8f-4e4a-8ee2-40bf07f6fdb8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:23.656848 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5d976c0-db8f-4e4a-8ee2-40bf07f6fdb8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:23.660674 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5d976c0-db8f-4e4a-8ee2-40bf07f6fdb8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:23.662461 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5d976c0-db8f-4e4a-8ee2-40bf07f6fdb8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:23.663101 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e5d976c0-db8f-4e4a-8ee2-40bf07f6fdb8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:23.762854 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4fe5bd72-93cf-465b-af2c-0929e4452e25 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:23.802248 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4fe5bd72-93cf-465b-af2c-0929e4452e25 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1314 microversion: 2.1 time: 1.072271 Aug 29 20:35:23.805045 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 157/312] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:22 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1314 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:23.909337 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1317a5cc-1939-4d9c-9ec4-3f916446f6b2 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:23.910040 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1317a5cc-1939-4d9c-9ec4-3f916446f6b2 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:23.970956 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1317a5cc-1939-4d9c-9ec4-3f916446f6b2 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:23.971445 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1317a5cc-1939-4d9c-9ec4-3f916446f6b2 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:23.971885 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1317a5cc-1939-4d9c-9ec4-3f916446f6b2 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:23.972633 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1317a5cc-1939-4d9c-9ec4-3f916446f6b2 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:23.973087 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1317a5cc-1939-4d9c-9ec4-3f916446f6b2 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:23.973508 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1317a5cc-1939-4d9c-9ec4-3f916446f6b2 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:24.376598 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e5d976c0-db8f-4e4a-8ee2-40bf07f6fdb8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:24.390409 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e5d976c0-db8f-4e4a-8ee2-40bf07f6fdb8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1297 microversion: 2.1 time: 0.753842 Aug 29 20:35:24.394341 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 156/313] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:23 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1297 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:24.639968 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1317a5cc-1939-4d9c-9ec4-3f916446f6b2 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:24.649789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1317a5cc-1939-4d9c-9ec4-3f916446f6b2 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1700 microversion: 2.1 time: 0.753675 Aug 29 20:35:24.651516 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 158/314] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:23 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1700 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:24.677173 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-79b5c3af-269c-4915-96af-1399f0450d28 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:24.688777 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79b5c3af-269c-4915-96af-1399f0450d28 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:24.691195 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79b5c3af-269c-4915-96af-1399f0450d28 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:24.693025 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79b5c3af-269c-4915-96af-1399f0450d28 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:24.826794 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ecf4b0cf-0cca-486f-9d7f-a4bbd9dc5c10 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:24.828248 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ecf4b0cf-0cca-486f-9d7f-a4bbd9dc5c10 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:24.836267 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-79b5c3af-269c-4915-96af-1399f0450d28 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Going to try to start instance {{(pid=127028) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 20:35:24.838813 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ecf4b0cf-0cca-486f-9d7f-a4bbd9dc5c10 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:24.841813 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ecf4b0cf-0cca-486f-9d7f-a4bbd9dc5c10 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:24.842484 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ecf4b0cf-0cca-486f-9d7f-a4bbd9dc5c10 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:24.843592 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ecf4b0cf-0cca-486f-9d7f-a4bbd9dc5c10 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:24.856175 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ecf4b0cf-0cca-486f-9d7f-a4bbd9dc5c10 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:24.857079 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ecf4b0cf-0cca-486f-9d7f-a4bbd9dc5c10 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:24.918525 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-79b5c3af-269c-4915-96af-1399f0450d28 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "POST /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/action" status: 202 len: 0 microversion: 2.1 time: 0.244913 Aug 29 20:35:24.920108 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 157/315] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 29 20:35:24 2022] POST /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:35:24.934746 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b018e134-b24e-435f-a0e8-3dfdb5324fdb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:24.936438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b018e134-b24e-435f-a0e8-3dfdb5324fdb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:24.950716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b018e134-b24e-435f-a0e8-3dfdb5324fdb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:24.951518 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b018e134-b24e-435f-a0e8-3dfdb5324fdb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:24.952379 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b018e134-b24e-435f-a0e8-3dfdb5324fdb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:24.953936 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b018e134-b24e-435f-a0e8-3dfdb5324fdb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:24.955723 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b018e134-b24e-435f-a0e8-3dfdb5324fdb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:24.956447 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b018e134-b24e-435f-a0e8-3dfdb5324fdb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:25.215056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-b018e134-b24e-435f-a0e8-3dfdb5324fdb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:25.225549 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b018e134-b24e-435f-a0e8-3dfdb5324fdb tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1709 microversion: 2.1 time: 0.299420 Aug 29 20:35:25.239071 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 158/316] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:24 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1709 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:25.248274 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-ecf4b0cf-0cca-486f-9d7f-a4bbd9dc5c10 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:25.257000 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ecf4b0cf-0cca-486f-9d7f-a4bbd9dc5c10 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1314 microversion: 2.1 time: 0.434861 Aug 29 20:35:25.257577 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 159/317] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:24 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:25.421305 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a420b717-5a85-47dc-bffa-08a3cc876177 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:25.422547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a420b717-5a85-47dc-bffa-08a3cc876177 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:25.450221 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a420b717-5a85-47dc-bffa-08a3cc876177 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:25.451352 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a420b717-5a85-47dc-bffa-08a3cc876177 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:25.452561 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a420b717-5a85-47dc-bffa-08a3cc876177 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:25.453354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a420b717-5a85-47dc-bffa-08a3cc876177 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:25.455999 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a420b717-5a85-47dc-bffa-08a3cc876177 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:25.459224 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a420b717-5a85-47dc-bffa-08a3cc876177 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:25.850345 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a420b717-5a85-47dc-bffa-08a3cc876177 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:25.865652 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a420b717-5a85-47dc-bffa-08a3cc876177 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1303 microversion: 2.1 time: 0.451830 Aug 29 20:35:25.879653 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 159/318] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:25 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1303 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:25.962437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-76af972c-74ac-494f-a034-c6cb74e673d1 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Action: 'create', calling method: .version_select at 0x7f48635a6310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2098198135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArRuaP4vyW3W/xYp19PdU2krkEv9LuO9nVCZjM5iNvBkSkJibEM0USUsdEq6Ogi6ED58T/gK+leRRlhfgYu4RANrC5pLS4wmfrMGEM4TLll7wCRCLuep2TMZzcxK2GzYg=="}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:25.978264 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-76af972c-74ac-494f-a034-c6cb74e673d1 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Getting quotas for project 3f36c1186e0f44df87d13ef836f6525b. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:35:25.983246 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-76af972c-74ac-494f-a034-c6cb74e673d1 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Getting quotas for user 448dc80e8c1b486fbdf83317209528eb and project 3f36c1186e0f44df87d13ef836f6525b. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:35:26.011900 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-76af972c-74ac-494f-a034-c6cb74e673d1 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053638 Aug 29 20:35:26.026922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 160/319] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 29 20:35:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:26.245245 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-121856440", "imageRef": "753284cb-7001-4655-b119-0e1dfce77ad3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2098198135", "networks": [{"uuid": "c5abf10f-92d1-4beb-ac39-bbd96f2c495a"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:26.253343 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-771162dc-00a8-4778-961d-91dad28677e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:26.255461 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-771162dc-00a8-4778-961d-91dad28677e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:26.271858 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-771162dc-00a8-4778-961d-91dad28677e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:26.274531 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-771162dc-00a8-4778-961d-91dad28677e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:26.275277 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-771162dc-00a8-4778-961d-91dad28677e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:26.276245 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-771162dc-00a8-4778-961d-91dad28677e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:26.276881 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-771162dc-00a8-4778-961d-91dad28677e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:26.278283 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-771162dc-00a8-4778-961d-91dad28677e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:26.355311 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] validate_networks() for [('c5abf10f-92d1-4beb-ac39-bbd96f2c495a', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:35:26.644017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-771162dc-00a8-4778-961d-91dad28677e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:26.653877 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-771162dc-00a8-4778-961d-91dad28677e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1709 microversion: 2.1 time: 0.406751 Aug 29 20:35:26.654480 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 161/320] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:26 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1709 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:26.659333 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-87899d6e-f66b-4c82-b689-989e1098afae tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:26.659977 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-87899d6e-f66b-4c82-b689-989e1098afae tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:26.683904 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-87899d6e-f66b-4c82-b689-989e1098afae tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:26.684443 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-87899d6e-f66b-4c82-b689-989e1098afae tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:26.684885 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-87899d6e-f66b-4c82-b689-989e1098afae tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:26.685619 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-87899d6e-f66b-4c82-b689-989e1098afae tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:26.686075 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-87899d6e-f66b-4c82-b689-989e1098afae tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:26.686497 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-87899d6e-f66b-4c82-b689-989e1098afae tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:26.908034 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-87899d6e-f66b-4c82-b689-989e1098afae tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:26.916997 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-87899d6e-f66b-4c82-b689-989e1098afae tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1314 microversion: 2.1 time: 0.261441 Aug 29 20:35:26.917895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 162/321] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:26 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:26.932584 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-821fd1f3-42f1-443f-a76f-4a9a10d267e9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:26.933518 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-821fd1f3-42f1-443f-a76f-4a9a10d267e9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:26.943594 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-821fd1f3-42f1-443f-a76f-4a9a10d267e9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:26.944462 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-821fd1f3-42f1-443f-a76f-4a9a10d267e9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:26.945231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-821fd1f3-42f1-443f-a76f-4a9a10d267e9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:26.946279 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-821fd1f3-42f1-443f-a76f-4a9a10d267e9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:26.947385 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-821fd1f3-42f1-443f-a76f-4a9a10d267e9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:26.949437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-821fd1f3-42f1-443f-a76f-4a9a10d267e9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:27.055620 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-821fd1f3-42f1-443f-a76f-4a9a10d267e9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:27.074509 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=100 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:27.082695 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-821fd1f3-42f1-443f-a76f-4a9a10d267e9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1303 microversion: 2.1 time: 0.162495 Aug 29 20:35:27.083640 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 163/322] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:26 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1303 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:27.675744 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e82bfe6e-d85d-4d42-acba-ae85208c24de tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:27.676496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e82bfe6e-d85d-4d42-acba-ae85208c24de tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:27.686954 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e82bfe6e-d85d-4d42-acba-ae85208c24de tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:27.691368 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e82bfe6e-d85d-4d42-acba-ae85208c24de tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:27.691886 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e82bfe6e-d85d-4d42-acba-ae85208c24de tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:27.697276 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e82bfe6e-d85d-4d42-acba-ae85208c24de tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:27.698031 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e82bfe6e-d85d-4d42-acba-ae85208c24de tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:27.698473 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e82bfe6e-d85d-4d42-acba-ae85208c24de tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:27.889539 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e82bfe6e-d85d-4d42-acba-ae85208c24de tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:27.902065 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e82bfe6e-d85d-4d42-acba-ae85208c24de tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1709 microversion: 2.1 time: 0.229178 Aug 29 20:35:27.903302 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 164/323] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:27 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1709 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:27.938172 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-84f809f0-abb8-4a66-a126-9ebc27063c9a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:27.938779 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-84f809f0-abb8-4a66-a126-9ebc27063c9a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:27.944979 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-84f809f0-abb8-4a66-a126-9ebc27063c9a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:27.945743 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-84f809f0-abb8-4a66-a126-9ebc27063c9a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:27.946480 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-84f809f0-abb8-4a66-a126-9ebc27063c9a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:27.967969 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-84f809f0-abb8-4a66-a126-9ebc27063c9a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:27.968842 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-84f809f0-abb8-4a66-a126-9ebc27063c9a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:27.969484 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-84f809f0-abb8-4a66-a126-9ebc27063c9a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:27.990594 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:35:27.991869 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:35:27.992571 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:35:27.993196 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:35:27.993960 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:35:28.006832 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:28.009301 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:28.011495 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:28.012542 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:28.014277 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:28.014916 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:28.043909 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Getting quotas for project 3f36c1186e0f44df87d13ef836f6525b. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:35:28.048973 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Getting quotas for user 448dc80e8c1b486fbdf83317209528eb and project 3f36c1186e0f44df87d13ef836f6525b. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:35:28.063724 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:28.065711 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:35:28.068517 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='753284cb-7001-4655-b119-0e1dfce77ad3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:35:28.148540 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ba28f3b5-a54d-4411-b415-d99d36c114df tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.909053 Aug 29 20:35:28.149728 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 160/324] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:35:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:35:28.155385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e7746505-f546-47c9-9380-569b936ced56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:28.156326 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e7746505-f546-47c9-9380-569b936ced56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:28.169962 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7746505-f546-47c9-9380-569b936ced56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:28.170788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7746505-f546-47c9-9380-569b936ced56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:28.171588 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7746505-f546-47c9-9380-569b936ced56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:28.172573 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7746505-f546-47c9-9380-569b936ced56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:28.173342 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7746505-f546-47c9-9380-569b936ced56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:28.173982 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e7746505-f546-47c9-9380-569b936ced56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:28.229510 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-84f809f0-abb8-4a66-a126-9ebc27063c9a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:28.237712 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-84f809f0-abb8-4a66-a126-9ebc27063c9a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1314 microversion: 2.1 time: 0.303322 Aug 29 20:35:28.245668 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 165/325] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:27 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:28.260129 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-5d41f1a6-e90a-46cb-8198-bdc13aca72aa tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:28.262002 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-5d41f1a6-e90a-46cb-8198-bdc13aca72aa tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:28.421995 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-5d41f1a6-e90a-46cb-8198-bdc13aca72aa tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:28.453878 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-5d41f1a6-e90a-46cb-8198-bdc13aca72aa tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1258 microversion: 2.1 time: 0.207038 Aug 29 20:35:28.456168 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 166/326] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:28 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1258 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:28.603134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e7746505-f546-47c9-9380-569b936ced56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:28.623013 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e7746505-f546-47c9-9380-569b936ced56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.470948 Aug 29 20:35:28.623916 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 161/327] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:28 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:28.927678 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2b64bedc-f744-4c30-92fa-4a6b99dbc923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:28.928855 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2b64bedc-f744-4c30-92fa-4a6b99dbc923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:28.938885 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2b64bedc-f744-4c30-92fa-4a6b99dbc923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:28.939619 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2b64bedc-f744-4c30-92fa-4a6b99dbc923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:28.940302 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2b64bedc-f744-4c30-92fa-4a6b99dbc923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:28.942911 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2b64bedc-f744-4c30-92fa-4a6b99dbc923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:28.943833 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2b64bedc-f744-4c30-92fa-4a6b99dbc923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:28.944463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2b64bedc-f744-4c30-92fa-4a6b99dbc923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:29.161124 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2b64bedc-f744-4c30-92fa-4a6b99dbc923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:29.174034 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2b64bedc-f744-4c30-92fa-4a6b99dbc923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1709 microversion: 2.1 time: 0.253295 Aug 29 20:35:29.176042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 167/328] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:28 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1709 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:29.265529 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4ed85e79-510e-4d06-b850-c8df1d769fa6 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:29.266435 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4ed85e79-510e-4d06-b850-c8df1d769fa6 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:29.282474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ed85e79-510e-4d06-b850-c8df1d769fa6 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:29.283209 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ed85e79-510e-4d06-b850-c8df1d769fa6 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:29.284316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ed85e79-510e-4d06-b850-c8df1d769fa6 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:29.285428 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ed85e79-510e-4d06-b850-c8df1d769fa6 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:29.286028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ed85e79-510e-4d06-b850-c8df1d769fa6 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:29.286594 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ed85e79-510e-4d06-b850-c8df1d769fa6 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:29.476449 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8aa14664-9d4a-4336-97e0-68a751eb5776 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:29.477735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8aa14664-9d4a-4336-97e0-68a751eb5776 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:29.484197 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8aa14664-9d4a-4336-97e0-68a751eb5776 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:29.485063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8aa14664-9d4a-4336-97e0-68a751eb5776 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:29.485735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8aa14664-9d4a-4336-97e0-68a751eb5776 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:29.486712 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8aa14664-9d4a-4336-97e0-68a751eb5776 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:29.487415 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8aa14664-9d4a-4336-97e0-68a751eb5776 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:29.488087 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8aa14664-9d4a-4336-97e0-68a751eb5776 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:29.598517 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-4ed85e79-510e-4d06-b850-c8df1d769fa6 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:29.610498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8aa14664-9d4a-4336-97e0-68a751eb5776 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:29.611123 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4ed85e79-510e-4d06-b850-c8df1d769fa6 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1314 microversion: 2.1 time: 0.347907 Aug 29 20:35:29.662305 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 162/329] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:29 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:29.667307 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8aa14664-9d4a-4336-97e0-68a751eb5776 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1254 microversion: 2.1 time: 0.194082 Aug 29 20:35:29.668767 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 168/330] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:29 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1254 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:29.686211 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3d9a5e15-9491-4346-9765-ba082d1743b8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:29.699660 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3d9a5e15-9491-4346-9765-ba082d1743b8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:29.715712 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-ede2e966-471d-4c49-aa03-28d685b4017f req-40557f06-7be7-416d-a2ef-45b9f245981c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64544993-4d2e-4125-9371-c55b598a4ab1", "tag": "85b94151-961e-4568-b1f6-9b9ec1883e9a"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:29.717796 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d9a5e15-9491-4346-9765-ba082d1743b8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:29.720635 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d9a5e15-9491-4346-9765-ba082d1743b8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:29.723631 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d9a5e15-9491-4346-9765-ba082d1743b8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:29.724704 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d9a5e15-9491-4346-9765-ba082d1743b8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:29.725409 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d9a5e15-9491-4346-9765-ba082d1743b8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:29.726398 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d9a5e15-9491-4346-9765-ba082d1743b8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:29.739292 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-ede2e966-471d-4c49-aa03-28d685b4017f req-40557f06-7be7-416d-a2ef-45b9f245981c service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:29.739805 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-ede2e966-471d-4c49-aa03-28d685b4017f req-40557f06-7be7-416d-a2ef-45b9f245981c service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:29.744072 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-ede2e966-471d-4c49-aa03-28d685b4017f req-40557f06-7be7-416d-a2ef-45b9f245981c service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:29.769264 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-ede2e966-471d-4c49-aa03-28d685b4017f req-40557f06-7be7-416d-a2ef-45b9f245981c service nova] Creating event network-changed:85b94151-961e-4568-b1f6-9b9ec1883e9a for instance 64544993-4d2e-4125-9371-c55b598a4ab1 on hv-cinder-85426 Aug 29 20:35:29.781906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-ede2e966-471d-4c49-aa03-28d685b4017f req-40557f06-7be7-416d-a2ef-45b9f245981c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071964 Aug 29 20:35:29.783344 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 169/331] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:35:29.924869 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-e9377024-c1d6-424f-b30d-ff9474b5f919 req-90d5910f-1a18-4976-8b5e-b7de6c67571c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357d9e2a-8aa3-4f1b-92ab-0c4db7649f43", "name": "network-vif-plugged", "status": "completed", "tag": "1e1cfa6b-3a3e-4dfe-b010-9376ec5e6023"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:29.947303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-e9377024-c1d6-424f-b30d-ff9474b5f919 req-90d5910f-1a18-4976-8b5e-b7de6c67571c service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:29.948823 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-e9377024-c1d6-424f-b30d-ff9474b5f919 req-90d5910f-1a18-4976-8b5e-b7de6c67571c service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:29.949509 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-e9377024-c1d6-424f-b30d-ff9474b5f919 req-90d5910f-1a18-4976-8b5e-b7de6c67571c service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:29.965313 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-e9377024-c1d6-424f-b30d-ff9474b5f919 req-90d5910f-1a18-4976-8b5e-b7de6c67571c service nova] Creating event network-vif-plugged:1e1cfa6b-3a3e-4dfe-b010-9376ec5e6023 for instance 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 on hv-cinder-85426 Aug 29 20:35:29.972997 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-e9377024-c1d6-424f-b30d-ff9474b5f919 req-90d5910f-1a18-4976-8b5e-b7de6c67571c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054950 Aug 29 20:35:29.974487 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 170/332] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:35:30.203921 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8994baab-b2bb-49ae-9ce6-5d1c019e579c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:30.205066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8994baab-b2bb-49ae-9ce6-5d1c019e579c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:30.218906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8994baab-b2bb-49ae-9ce6-5d1c019e579c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:30.220576 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8994baab-b2bb-49ae-9ce6-5d1c019e579c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:30.221186 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8994baab-b2bb-49ae-9ce6-5d1c019e579c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:30.222639 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8994baab-b2bb-49ae-9ce6-5d1c019e579c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:30.223964 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8994baab-b2bb-49ae-9ce6-5d1c019e579c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:30.228279 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d9a5e15-9491-4346-9765-ba082d1743b8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:30.236946 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3d9a5e15-9491-4346-9765-ba082d1743b8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.572414 Aug 29 20:35:30.237587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 163/333] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:29 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:30.259094 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8994baab-b2bb-49ae-9ce6-5d1c019e579c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:30.575445 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8994baab-b2bb-49ae-9ce6-5d1c019e579c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:30.585866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8994baab-b2bb-49ae-9ce6-5d1c019e579c tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1713 microversion: 2.1 time: 0.390396 Aug 29 20:35:30.586603 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 171/334] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:30 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1713 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:30.633552 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-78235ed4-cb77-4c5d-a08c-47cdb01c2705 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:30.634211 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-78235ed4-cb77-4c5d-a08c-47cdb01c2705 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:30.640835 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78235ed4-cb77-4c5d-a08c-47cdb01c2705 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:30.641630 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78235ed4-cb77-4c5d-a08c-47cdb01c2705 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:30.642093 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78235ed4-cb77-4c5d-a08c-47cdb01c2705 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:30.642882 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78235ed4-cb77-4c5d-a08c-47cdb01c2705 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:30.643361 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78235ed4-cb77-4c5d-a08c-47cdb01c2705 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:30.643751 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-78235ed4-cb77-4c5d-a08c-47cdb01c2705 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:30.695566 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2f484040-0219-46be-b4d7-3f7bb71b90c9 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:30.698708 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2f484040-0219-46be-b4d7-3f7bb71b90c9 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:30.739621 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f484040-0219-46be-b4d7-3f7bb71b90c9 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:30.740619 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f484040-0219-46be-b4d7-3f7bb71b90c9 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:30.741343 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f484040-0219-46be-b4d7-3f7bb71b90c9 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:30.742245 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f484040-0219-46be-b4d7-3f7bb71b90c9 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:30.743164 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f484040-0219-46be-b4d7-3f7bb71b90c9 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:30.743774 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f484040-0219-46be-b4d7-3f7bb71b90c9 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:30.841073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-78235ed4-cb77-4c5d-a08c-47cdb01c2705 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:30.851542 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-78235ed4-cb77-4c5d-a08c-47cdb01c2705 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1314 microversion: 2.1 time: 0.222151 Aug 29 20:35:30.852456 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 164/335] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:30 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:30.874612 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2f484040-0219-46be-b4d7-3f7bb71b90c9 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:30.889557 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2f484040-0219-46be-b4d7-3f7bb71b90c9 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1310 microversion: 2.1 time: 0.203510 Aug 29 20:35:30.890141 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 172/336] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:30 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1310 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:31.262119 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-868325a8-28c1-4bc6-a14d-9706bf0141d9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:31.263215 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-868325a8-28c1-4bc6-a14d-9706bf0141d9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:31.276660 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-868325a8-28c1-4bc6-a14d-9706bf0141d9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:31.278709 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-868325a8-28c1-4bc6-a14d-9706bf0141d9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:31.290013 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-868325a8-28c1-4bc6-a14d-9706bf0141d9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:31.296713 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-868325a8-28c1-4bc6-a14d-9706bf0141d9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:31.297278 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-868325a8-28c1-4bc6-a14d-9706bf0141d9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:31.297795 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-868325a8-28c1-4bc6-a14d-9706bf0141d9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:31.336830 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:31.874571 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4ce1b25b-51d9-4f8a-a02f-742a6b5d2c0f tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:31.876101 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4ce1b25b-51d9-4f8a-a02f-742a6b5d2c0f tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:31.882796 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4ce1b25b-51d9-4f8a-a02f-742a6b5d2c0f tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:31.883338 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4ce1b25b-51d9-4f8a-a02f-742a6b5d2c0f tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:31.883829 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4ce1b25b-51d9-4f8a-a02f-742a6b5d2c0f tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:31.884899 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4ce1b25b-51d9-4f8a-a02f-742a6b5d2c0f tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:31.885614 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4ce1b25b-51d9-4f8a-a02f-742a6b5d2c0f tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:31.886043 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4ce1b25b-51d9-4f8a-a02f-742a6b5d2c0f tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:32.099873 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-868325a8-28c1-4bc6-a14d-9706bf0141d9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:32.109974 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-868325a8-28c1-4bc6-a14d-9706bf0141d9 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.854206 Aug 29 20:35:32.111175 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 165/337] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:31 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:32.112950 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4ce1b25b-51d9-4f8a-a02f-742a6b5d2c0f tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:32.116513 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5d0e4357-1359-48d7-82b1-0d697c06352e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:32.117324 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5d0e4357-1359-48d7-82b1-0d697c06352e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:32.130082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4ce1b25b-51d9-4f8a-a02f-742a6b5d2c0f tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1314 microversion: 2.1 time: 0.259669 Aug 29 20:35:32.130666 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 173/338] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:31 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:32.132889 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d0e4357-1359-48d7-82b1-0d697c06352e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:32.136659 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d0e4357-1359-48d7-82b1-0d697c06352e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:32.137525 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d0e4357-1359-48d7-82b1-0d697c06352e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:32.138516 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d0e4357-1359-48d7-82b1-0d697c06352e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:32.139739 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d0e4357-1359-48d7-82b1-0d697c06352e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:32.140343 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5d0e4357-1359-48d7-82b1-0d697c06352e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:32.237479 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5d0e4357-1359-48d7-82b1-0d697c06352e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:32.248882 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5d0e4357-1359-48d7-82b1-0d697c06352e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1316 microversion: 2.1 time: 0.136432 Aug 29 20:35:32.249619 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 166/339] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:32 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1316 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:33.133382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d279d5bd-7425-4842-a8cc-ae6ae18d1673 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:33.134078 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d279d5bd-7425-4842-a8cc-ae6ae18d1673 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:33.140781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d279d5bd-7425-4842-a8cc-ae6ae18d1673 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:33.141251 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d279d5bd-7425-4842-a8cc-ae6ae18d1673 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:33.141769 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d279d5bd-7425-4842-a8cc-ae6ae18d1673 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:33.144581 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d279d5bd-7425-4842-a8cc-ae6ae18d1673 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:33.145059 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d279d5bd-7425-4842-a8cc-ae6ae18d1673 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:33.145485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d279d5bd-7425-4842-a8cc-ae6ae18d1673 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:33.156255 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d36ca921-68ff-403e-8023-4f1f1fd9d088 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:33.157022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d36ca921-68ff-403e-8023-4f1f1fd9d088 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:33.163307 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d36ca921-68ff-403e-8023-4f1f1fd9d088 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:33.163795 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d36ca921-68ff-403e-8023-4f1f1fd9d088 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:33.164252 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d36ca921-68ff-403e-8023-4f1f1fd9d088 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:33.165153 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d36ca921-68ff-403e-8023-4f1f1fd9d088 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:33.165617 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d36ca921-68ff-403e-8023-4f1f1fd9d088 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:33.166042 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d36ca921-68ff-403e-8023-4f1f1fd9d088 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:33.359348 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d279d5bd-7425-4842-a8cc-ae6ae18d1673 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:33.374355 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d279d5bd-7425-4842-a8cc-ae6ae18d1673 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.245074 Aug 29 20:35:33.375111 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 174/340] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:33 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:33.386638 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f411d8df-e159-43c8-b6b8-908a5d957768 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:33.388198 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-f411d8df-e159-43c8-b6b8-908a5d957768 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:33.401875 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f411d8df-e159-43c8-b6b8-908a5d957768 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:33.402368 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f411d8df-e159-43c8-b6b8-908a5d957768 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:33.402797 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f411d8df-e159-43c8-b6b8-908a5d957768 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:33.411897 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f411d8df-e159-43c8-b6b8-908a5d957768 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:33.418355 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f411d8df-e159-43c8-b6b8-908a5d957768 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:33.419188 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f411d8df-e159-43c8-b6b8-908a5d957768 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:33.644959 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-d36ca921-68ff-403e-8023-4f1f1fd9d088 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:33.654608 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-f411d8df-e159-43c8-b6b8-908a5d957768 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:33.676185 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-f411d8df-e159-43c8-b6b8-908a5d957768 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.288972 Aug 29 20:35:33.677464 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 175/341] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:33 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:33.695453 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d36ca921-68ff-403e-8023-4f1f1fd9d088 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1498 microversion: 2.1 time: 0.539210 Aug 29 20:35:33.710553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 167/342] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:33 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1498 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:34.352042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ab9d4687-97d4-4f93-a63b-66d788ef0f6d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:34.353147 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ab9d4687-97d4-4f93-a63b-66d788ef0f6d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:34.369162 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ab9d4687-97d4-4f93-a63b-66d788ef0f6d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:34.370430 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ab9d4687-97d4-4f93-a63b-66d788ef0f6d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:34.371023 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ab9d4687-97d4-4f93-a63b-66d788ef0f6d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:34.371916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ab9d4687-97d4-4f93-a63b-66d788ef0f6d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:34.372553 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ab9d4687-97d4-4f93-a63b-66d788ef0f6d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:34.373129 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ab9d4687-97d4-4f93-a63b-66d788ef0f6d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:34.394863 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3b515a24-32a8-4d72-920b-ae68f1a49e00 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:34.395721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3b515a24-32a8-4d72-920b-ae68f1a49e00 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:34.410276 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b515a24-32a8-4d72-920b-ae68f1a49e00 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:34.411250 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b515a24-32a8-4d72-920b-ae68f1a49e00 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:34.412736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b515a24-32a8-4d72-920b-ae68f1a49e00 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:34.413826 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b515a24-32a8-4d72-920b-ae68f1a49e00 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:34.414540 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b515a24-32a8-4d72-920b-ae68f1a49e00 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:34.415250 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b515a24-32a8-4d72-920b-ae68f1a49e00 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:34.450365 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ab9d4687-97d4-4f93-a63b-66d788ef0f6d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Going to try to terminate instance {{(pid=127027) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:35:34.649954 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ab9d4687-97d4-4f93-a63b-66d788ef0f6d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "DELETE /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 204 len: 0 microversion: 2.1 time: 0.301246 Aug 29 20:35:34.652185 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 176/343] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:35:34 2022] DELETE /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:35:34.672734 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-3f72fdba-5c4a-4866-b220-c9b1f94abafc tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:34.673620 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-3f72fdba-5c4a-4866-b220-c9b1f94abafc tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:34.687175 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:34.690227 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3f72fdba-5c4a-4866-b220-c9b1f94abafc tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:34.695026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3f72fdba-5c4a-4866-b220-c9b1f94abafc tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:34.696519 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3f72fdba-5c4a-4866-b220-c9b1f94abafc tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:34.699554 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3f72fdba-5c4a-4866-b220-c9b1f94abafc tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:34.700332 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3f72fdba-5c4a-4866-b220-c9b1f94abafc tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:34.700981 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3f72fdba-5c4a-4866-b220-c9b1f94abafc tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:35.014444 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-3f72fdba-5c4a-4866-b220-c9b1f94abafc tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:35.028552 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-3f72fdba-5c4a-4866-b220-c9b1f94abafc tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1504 microversion: 2.1 time: 0.367737 Aug 29 20:35:35.030695 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 177/344] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:34 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:35.039173 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-bcac7250-ffca-403e-a21f-5cb2725fadc2 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:35.040998 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-bcac7250-ffca-403e-a21f-5cb2725fadc2 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:35.049652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bcac7250-ffca-403e-a21f-5cb2725fadc2 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:35.050977 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bcac7250-ffca-403e-a21f-5cb2725fadc2 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:35.051581 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bcac7250-ffca-403e-a21f-5cb2725fadc2 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:35.055042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bcac7250-ffca-403e-a21f-5cb2725fadc2 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:35.056064 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bcac7250-ffca-403e-a21f-5cb2725fadc2 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:35.057042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bcac7250-ffca-403e-a21f-5cb2725fadc2 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:35.141494 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3b515a24-32a8-4d72-920b-ae68f1a49e00 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:35.171108 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3b515a24-32a8-4d72-920b-ae68f1a49e00 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.780102 Aug 29 20:35:35.172247 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 168/345] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:34 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:35.436172 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-bcac7250-ffca-403e-a21f-5cb2725fadc2 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:35.456228 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-bcac7250-ffca-403e-a21f-5cb2725fadc2 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.423828 Aug 29 20:35:35.467973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 178/346] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:35 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:36.050862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dcc8e6e7-3f75-4c32-92fe-c2f6b7d6cea1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:36.052902 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dcc8e6e7-3f75-4c32-92fe-c2f6b7d6cea1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:36.064126 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcc8e6e7-3f75-4c32-92fe-c2f6b7d6cea1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:36.064622 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcc8e6e7-3f75-4c32-92fe-c2f6b7d6cea1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:36.065064 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcc8e6e7-3f75-4c32-92fe-c2f6b7d6cea1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:36.068957 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcc8e6e7-3f75-4c32-92fe-c2f6b7d6cea1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:36.069671 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcc8e6e7-3f75-4c32-92fe-c2f6b7d6cea1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:36.070267 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dcc8e6e7-3f75-4c32-92fe-c2f6b7d6cea1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:36.200400 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-bda66205-b6f3-4904-8d06-06af30df6bb5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:36.201775 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-bda66205-b6f3-4904-8d06-06af30df6bb5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:36.207920 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bda66205-b6f3-4904-8d06-06af30df6bb5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:36.208649 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bda66205-b6f3-4904-8d06-06af30df6bb5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:36.209081 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bda66205-b6f3-4904-8d06-06af30df6bb5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:36.209798 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bda66205-b6f3-4904-8d06-06af30df6bb5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:36.210393 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bda66205-b6f3-4904-8d06-06af30df6bb5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:36.210836 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bda66205-b6f3-4904-8d06-06af30df6bb5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:36.526023 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-bda66205-b6f3-4904-8d06-06af30df6bb5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:36.535717 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-bda66205-b6f3-4904-8d06-06af30df6bb5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.340174 Aug 29 20:35:36.536329 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 179/347] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:36 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:36.541085 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-28e0a469-47b2-4c98-b185-1cd327e5a6d8 req-582cac2f-2442-4d84-a913-eac76adf63a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68772d1-e335-4575-9654-313e27c49591", "tag": "d63c8d5b-2b84-4f67-944f-9f299a5aa8cb"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:36.541418 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-dcc8e6e7-3f75-4c32-92fe-c2f6b7d6cea1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:36.551228 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-28e0a469-47b2-4c98-b185-1cd327e5a6d8 req-582cac2f-2442-4d84-a913-eac76adf63a4 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:36.551697 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-28e0a469-47b2-4c98-b185-1cd327e5a6d8 req-582cac2f-2442-4d84-a913-eac76adf63a4 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:36.552181 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-28e0a469-47b2-4c98-b185-1cd327e5a6d8 req-582cac2f-2442-4d84-a913-eac76adf63a4 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:36.555489 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dcc8e6e7-3f75-4c32-92fe-c2f6b7d6cea1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1504 microversion: 2.1 time: 0.508445 Aug 29 20:35:36.556413 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 169/348] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:36 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1504 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:36.562097 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d779fe5-e5ea-4e96-8596-19029ebdb4d8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:36.562962 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d779fe5-e5ea-4e96-8596-19029ebdb4d8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:36.569958 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d779fe5-e5ea-4e96-8596-19029ebdb4d8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:36.570743 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d779fe5-e5ea-4e96-8596-19029ebdb4d8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:36.571177 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d779fe5-e5ea-4e96-8596-19029ebdb4d8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:36.571884 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d779fe5-e5ea-4e96-8596-19029ebdb4d8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:36.572378 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d779fe5-e5ea-4e96-8596-19029ebdb4d8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:36.573336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d779fe5-e5ea-4e96-8596-19029ebdb4d8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:36.577299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-28e0a469-47b2-4c98-b185-1cd327e5a6d8 req-582cac2f-2442-4d84-a913-eac76adf63a4 service nova] Creating event network-changed:d63c8d5b-2b84-4f67-944f-9f299a5aa8cb for instance b68772d1-e335-4575-9654-313e27c49591 on hv-cinder-85426 Aug 29 20:35:36.583155 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-28e0a469-47b2-4c98-b185-1cd327e5a6d8 req-582cac2f-2442-4d84-a913-eac76adf63a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045653 Aug 29 20:35:36.584090 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 180/349] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:36.813133 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-2d779fe5-e5ea-4e96-8596-19029ebdb4d8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:36.840740 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d779fe5-e5ea-4e96-8596-19029ebdb4d8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.282591 Aug 29 20:35:36.847561 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 170/350] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:36 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:37.557900 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b0daa529-4563-45f0-ae38-01406b146e75 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:37.558868 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b0daa529-4563-45f0-ae38-01406b146e75 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:37.566371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-9c9b8550-bae0-42fb-8251-79a3094c8d84 req-ac84c53a-8d24-4aff-93b6-3468a936403a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64544993-4d2e-4125-9371-c55b598a4ab1", "name": "network-vif-plugged", "status": "completed", "tag": "85b94151-961e-4568-b1f6-9b9ec1883e9a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:37.571687 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b0daa529-4563-45f0-ae38-01406b146e75 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:37.575883 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b0daa529-4563-45f0-ae38-01406b146e75 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:37.576667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b0daa529-4563-45f0-ae38-01406b146e75 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:37.577597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b0daa529-4563-45f0-ae38-01406b146e75 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:37.580561 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b0daa529-4563-45f0-ae38-01406b146e75 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:37.581255 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b0daa529-4563-45f0-ae38-01406b146e75 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:37.586175 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9c9b8550-bae0-42fb-8251-79a3094c8d84 req-ac84c53a-8d24-4aff-93b6-3468a936403a service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:37.586658 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9c9b8550-bae0-42fb-8251-79a3094c8d84 req-ac84c53a-8d24-4aff-93b6-3468a936403a service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:37.587089 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-9c9b8550-bae0-42fb-8251-79a3094c8d84 req-ac84c53a-8d24-4aff-93b6-3468a936403a service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:37.615531 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-9c9b8550-bae0-42fb-8251-79a3094c8d84 req-ac84c53a-8d24-4aff-93b6-3468a936403a service nova] Creating event network-vif-plugged:85b94151-961e-4568-b1f6-9b9ec1883e9a for instance 64544993-4d2e-4125-9371-c55b598a4ab1 on hv-cinder-85426 Aug 29 20:35:37.628683 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-9c9b8550-bae0-42fb-8251-79a3094c8d84 req-ac84c53a-8d24-4aff-93b6-3468a936403a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067204 Aug 29 20:35:37.629290 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 171/351] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:35:37.644942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-66cdeabe-c971-4a3a-988c-cf7ccd203b1d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:37.660570 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-66cdeabe-c971-4a3a-988c-cf7ccd203b1d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:37.675512 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66cdeabe-c971-4a3a-988c-cf7ccd203b1d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:37.678740 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66cdeabe-c971-4a3a-988c-cf7ccd203b1d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:37.679567 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66cdeabe-c971-4a3a-988c-cf7ccd203b1d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:37.681558 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66cdeabe-c971-4a3a-988c-cf7ccd203b1d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:37.682158 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66cdeabe-c971-4a3a-988c-cf7ccd203b1d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:37.685051 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66cdeabe-c971-4a3a-988c-cf7ccd203b1d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:37.925055 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b0daa529-4563-45f0-ae38-01406b146e75 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:37.934223 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:37.958893 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b0daa529-4563-45f0-ae38-01406b146e75 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.405694 Aug 29 20:35:37.964866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 181/352] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:37 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:37.971026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-00a09755-da7d-448b-8560-f95c66adbe87 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:37.975978 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-00a09755-da7d-448b-8560-f95c66adbe87 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:37.984219 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00a09755-da7d-448b-8560-f95c66adbe87 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:37.984802 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00a09755-da7d-448b-8560-f95c66adbe87 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:37.985473 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00a09755-da7d-448b-8560-f95c66adbe87 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:37.986410 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00a09755-da7d-448b-8560-f95c66adbe87 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:37.987075 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00a09755-da7d-448b-8560-f95c66adbe87 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:37.988004 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00a09755-da7d-448b-8560-f95c66adbe87 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:38.033322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:38.045322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-66cdeabe-c971-4a3a-988c-cf7ccd203b1d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:38.072408 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=12 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:38.081356 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-66cdeabe-c971-4a3a-988c-cf7ccd203b1d tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1504 microversion: 2.1 time: 0.445833 Aug 29 20:35:38.082453 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 172/353] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:37 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1504 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:38.261517 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-00a09755-da7d-448b-8560-f95c66adbe87 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:38.270656 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-00a09755-da7d-448b-8560-f95c66adbe87 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.304251 Aug 29 20:35:38.271445 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 182/354] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:37 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:39.008052 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-66266cba-efd1-4734-95b4-c2d0b1f29820 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:39.009239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-66266cba-efd1-4734-95b4-c2d0b1f29820 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:39.021606 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66266cba-efd1-4734-95b4-c2d0b1f29820 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:39.027889 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66266cba-efd1-4734-95b4-c2d0b1f29820 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:39.028618 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66266cba-efd1-4734-95b4-c2d0b1f29820 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:39.030151 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66266cba-efd1-4734-95b4-c2d0b1f29820 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:39.033580 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66266cba-efd1-4734-95b4-c2d0b1f29820 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:39.034363 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66266cba-efd1-4734-95b4-c2d0b1f29820 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:39.111835 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4adac6a3-fc2c-4159-9bfc-2a99dbe3e3be tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:39.112476 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4adac6a3-fc2c-4159-9bfc-2a99dbe3e3be tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:39.114591 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=24 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:39.128440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4adac6a3-fc2c-4159-9bfc-2a99dbe3e3be tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:39.128936 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4adac6a3-fc2c-4159-9bfc-2a99dbe3e3be tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:39.129648 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4adac6a3-fc2c-4159-9bfc-2a99dbe3e3be tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:39.130163 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4adac6a3-fc2c-4159-9bfc-2a99dbe3e3be tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:39.130660 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4adac6a3-fc2c-4159-9bfc-2a99dbe3e3be tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:39.131100 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4adac6a3-fc2c-4159-9bfc-2a99dbe3e3be tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:39.443015 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-66266cba-efd1-4734-95b4-c2d0b1f29820 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:39.487599 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-66266cba-efd1-4734-95b4-c2d0b1f29820 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.488522 Aug 29 20:35:39.495328 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 173/355] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:38 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:39.511088 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bb52b220-3ec4-41cb-bae4-ea7e60928b3f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:39.523582 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bb52b220-3ec4-41cb-bae4-ea7e60928b3f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:39.538259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb52b220-3ec4-41cb-bae4-ea7e60928b3f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:39.558734 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb52b220-3ec4-41cb-bae4-ea7e60928b3f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:39.566423 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb52b220-3ec4-41cb-bae4-ea7e60928b3f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:39.568271 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb52b220-3ec4-41cb-bae4-ea7e60928b3f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:39.571809 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb52b220-3ec4-41cb-bae4-ea7e60928b3f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:39.572601 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bb52b220-3ec4-41cb-bae4-ea7e60928b3f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:39.935970 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bb52b220-3ec4-41cb-bae4-ea7e60928b3f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:39.957277 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bb52b220-3ec4-41cb-bae4-ea7e60928b3f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.455894 Aug 29 20:35:39.960300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 174/356] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:39 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:40.085904 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4adac6a3-fc2c-4159-9bfc-2a99dbe3e3be tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:40.111965 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4adac6a3-fc2c-4159-9bfc-2a99dbe3e3be tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1504 microversion: 2.1 time: 1.004569 Aug 29 20:35:40.113785 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 183/357] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:39 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1504 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:40.523602 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ef841c8-86ca-4852-a49d-9c8e9d6833e0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:40.525285 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ef841c8-86ca-4852-a49d-9c8e9d6833e0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:40.532288 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ef841c8-86ca-4852-a49d-9c8e9d6833e0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:40.533084 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ef841c8-86ca-4852-a49d-9c8e9d6833e0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:40.533685 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ef841c8-86ca-4852-a49d-9c8e9d6833e0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:40.534642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ef841c8-86ca-4852-a49d-9c8e9d6833e0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:40.535395 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ef841c8-86ca-4852-a49d-9c8e9d6833e0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:40.536172 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ef841c8-86ca-4852-a49d-9c8e9d6833e0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:40.924769 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ef841c8-86ca-4852-a49d-9c8e9d6833e0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:40.950082 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ef841c8-86ca-4852-a49d-9c8e9d6833e0 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.415990 Aug 29 20:35:40.971348 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 175/358] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:40 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:40.986915 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b31a3f9d-424d-4ff8-83d6-5825be0f721e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:40.987575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b31a3f9d-424d-4ff8-83d6-5825be0f721e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:40.995218 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b31a3f9d-424d-4ff8-83d6-5825be0f721e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:41.000590 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b31a3f9d-424d-4ff8-83d6-5825be0f721e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:41.001219 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b31a3f9d-424d-4ff8-83d6-5825be0f721e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:41.002024 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b31a3f9d-424d-4ff8-83d6-5825be0f721e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:41.002522 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b31a3f9d-424d-4ff8-83d6-5825be0f721e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:41.003064 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b31a3f9d-424d-4ff8-83d6-5825be0f721e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:41.136929 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b6dd930-0006-4957-a808-ae3e522c2dfe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:41.137557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7b6dd930-0006-4957-a808-ae3e522c2dfe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:41.149502 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b6dd930-0006-4957-a808-ae3e522c2dfe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:41.155007 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b6dd930-0006-4957-a808-ae3e522c2dfe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:41.155585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b6dd930-0006-4957-a808-ae3e522c2dfe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:41.156685 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b6dd930-0006-4957-a808-ae3e522c2dfe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:41.162756 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b6dd930-0006-4957-a808-ae3e522c2dfe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:41.163635 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b6dd930-0006-4957-a808-ae3e522c2dfe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:41.500240 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7b6dd930-0006-4957-a808-ae3e522c2dfe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:41.519714 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7b6dd930-0006-4957-a808-ae3e522c2dfe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1504 microversion: 2.1 time: 0.388226 Aug 29 20:35:41.521539 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 176/359] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:41 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:41.705912 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b31a3f9d-424d-4ff8-83d6-5825be0f721e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:41.717542 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b31a3f9d-424d-4ff8-83d6-5825be0f721e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.734707 Aug 29 20:35:41.727172 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 184/360] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:40 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:41.973365 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7cffc426-8483-4efb-9c3a-868f6710cf69 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:41.974590 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7cffc426-8483-4efb-9c3a-868f6710cf69 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:41.983263 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cffc426-8483-4efb-9c3a-868f6710cf69 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:41.984073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cffc426-8483-4efb-9c3a-868f6710cf69 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:41.984705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cffc426-8483-4efb-9c3a-868f6710cf69 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:41.985583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cffc426-8483-4efb-9c3a-868f6710cf69 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:41.986361 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cffc426-8483-4efb-9c3a-868f6710cf69 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:41.986947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7cffc426-8483-4efb-9c3a-868f6710cf69 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:42.212562 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7cffc426-8483-4efb-9c3a-868f6710cf69 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:42.230627 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7cffc426-8483-4efb-9c3a-868f6710cf69 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.261326 Aug 29 20:35:42.237377 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 177/361] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:41 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:42.544101 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-fabad979-853c-433c-a72d-11016fa1a2e5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:42.545142 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-fabad979-853c-433c-a72d-11016fa1a2e5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:42.560622 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fabad979-853c-433c-a72d-11016fa1a2e5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:42.561133 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fabad979-853c-433c-a72d-11016fa1a2e5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:42.561721 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fabad979-853c-433c-a72d-11016fa1a2e5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:42.562427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fabad979-853c-433c-a72d-11016fa1a2e5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:42.563058 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fabad979-853c-433c-a72d-11016fa1a2e5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:42.563638 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fabad979-853c-433c-a72d-11016fa1a2e5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:42.750947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-43c3dc93-082c-4a29-ac7b-1d6621bd9243 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:42.752775 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-43c3dc93-082c-4a29-ac7b-1d6621bd9243 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:42.764132 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43c3dc93-082c-4a29-ac7b-1d6621bd9243 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:42.764735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43c3dc93-082c-4a29-ac7b-1d6621bd9243 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:42.765415 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43c3dc93-082c-4a29-ac7b-1d6621bd9243 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:42.766465 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43c3dc93-082c-4a29-ac7b-1d6621bd9243 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:42.767148 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43c3dc93-082c-4a29-ac7b-1d6621bd9243 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:42.767798 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-43c3dc93-082c-4a29-ac7b-1d6621bd9243 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:42.997892 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-fabad979-853c-433c-a72d-11016fa1a2e5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:43.015541 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-fabad979-853c-433c-a72d-11016fa1a2e5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1504 microversion: 2.1 time: 0.475408 Aug 29 20:35:43.030322 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 185/362] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:42 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1504 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:43.100277 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-43c3dc93-082c-4a29-ac7b-1d6621bd9243 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:43.110680 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-43c3dc93-082c-4a29-ac7b-1d6621bd9243 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.367907 Aug 29 20:35:43.124844 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 178/363] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:42 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:43.254357 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-0a99532c-6fe7-4de3-aee1-ef48b8f90226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:43.256240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-0a99532c-6fe7-4de3-aee1-ef48b8f90226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:43.270358 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0a99532c-6fe7-4de3-aee1-ef48b8f90226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:43.273851 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0a99532c-6fe7-4de3-aee1-ef48b8f90226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:43.274739 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0a99532c-6fe7-4de3-aee1-ef48b8f90226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:43.275970 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0a99532c-6fe7-4de3-aee1-ef48b8f90226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:43.279857 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0a99532c-6fe7-4de3-aee1-ef48b8f90226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:43.280759 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0a99532c-6fe7-4de3-aee1-ef48b8f90226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:43.679841 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-0a99532c-6fe7-4de3-aee1-ef48b8f90226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:43.694937 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-0a99532c-6fe7-4de3-aee1-ef48b8f90226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.446427 Aug 29 20:35:43.699476 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 186/364] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:43 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:44.050576 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-45dbaff4-083e-4d8e-a995-f9c71104f866 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:44.051746 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-45dbaff4-083e-4d8e-a995-f9c71104f866 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:44.067584 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45dbaff4-083e-4d8e-a995-f9c71104f866 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:44.068674 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45dbaff4-083e-4d8e-a995-f9c71104f866 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:44.069392 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45dbaff4-083e-4d8e-a995-f9c71104f866 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:44.070118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45dbaff4-083e-4d8e-a995-f9c71104f866 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:44.070577 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45dbaff4-083e-4d8e-a995-f9c71104f866 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:44.071005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45dbaff4-083e-4d8e-a995-f9c71104f866 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:44.134019 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-abcf6cf9-b5c2-4f8d-bbc2-87b30574bf73 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:44.140168 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-abcf6cf9-b5c2-4f8d-bbc2-87b30574bf73 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:44.169624 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-abcf6cf9-b5c2-4f8d-bbc2-87b30574bf73 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:44.170379 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-abcf6cf9-b5c2-4f8d-bbc2-87b30574bf73 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:44.176677 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-abcf6cf9-b5c2-4f8d-bbc2-87b30574bf73 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:44.177429 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-abcf6cf9-b5c2-4f8d-bbc2-87b30574bf73 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:44.178077 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-abcf6cf9-b5c2-4f8d-bbc2-87b30574bf73 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:44.179506 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-abcf6cf9-b5c2-4f8d-bbc2-87b30574bf73 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:44.252260 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-45dbaff4-083e-4d8e-a995-f9c71104f866 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:44.262734 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-45dbaff4-083e-4d8e-a995-f9c71104f866 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1504 microversion: 2.1 time: 0.216994 Aug 29 20:35:44.266393 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 179/365] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:44 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:44.690677 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-abcf6cf9-b5c2-4f8d-bbc2-87b30574bf73 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:44.712385 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-abcf6cf9-b5c2-4f8d-bbc2-87b30574bf73 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.582259 Aug 29 20:35:44.713870 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 187/366] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:44 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:44.731031 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-53d03343-9ca2-4f7a-93b7-987b3fc98424 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:44.731779 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-53d03343-9ca2-4f7a-93b7-987b3fc98424 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:44.747496 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53d03343-9ca2-4f7a-93b7-987b3fc98424 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:44.749202 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53d03343-9ca2-4f7a-93b7-987b3fc98424 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:44.749955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53d03343-9ca2-4f7a-93b7-987b3fc98424 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:44.750911 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53d03343-9ca2-4f7a-93b7-987b3fc98424 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:44.752809 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53d03343-9ca2-4f7a-93b7-987b3fc98424 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:44.756831 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53d03343-9ca2-4f7a-93b7-987b3fc98424 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:45.233428 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-53d03343-9ca2-4f7a-93b7-987b3fc98424 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:45.251198 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-53d03343-9ca2-4f7a-93b7-987b3fc98424 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.525269 Aug 29 20:35:45.252280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 180/367] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:44 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:45.307023 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e770c8ad-ccf6-4404-aa3a-95046d9e5e88 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:45.309380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e770c8ad-ccf6-4404-aa3a-95046d9e5e88 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:45.325390 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e770c8ad-ccf6-4404-aa3a-95046d9e5e88 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:45.327598 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e770c8ad-ccf6-4404-aa3a-95046d9e5e88 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:45.341294 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e770c8ad-ccf6-4404-aa3a-95046d9e5e88 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:45.343018 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e770c8ad-ccf6-4404-aa3a-95046d9e5e88 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:45.348893 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e770c8ad-ccf6-4404-aa3a-95046d9e5e88 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:45.349420 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e770c8ad-ccf6-4404-aa3a-95046d9e5e88 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:45.440812 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-561670965", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-959246705", "security_groups": [{"name": "tempest-secgroup-smoke-372403117"}], "networks": [{"uuid": "779bade7-0633-4938-81a0-aee67711baac"}], "block_device_mapping_v2": [{"uuid": "afb23680-6a9b-48a9-ab10-4c75d585b3e8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:45.622539 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] validate_networks() for [('779bade7-0633-4938-81a0-aee67711baac', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:35:45.694964 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e770c8ad-ccf6-4404-aa3a-95046d9e5e88 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:45.712365 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e770c8ad-ccf6-4404-aa3a-95046d9e5e88 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1504 microversion: 2.1 time: 0.428367 Aug 29 20:35:45.714444 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 188/368] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:45 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:45.752275 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-31c3a0fb-8d73-4804-9af3-c302cb27a064 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:45.753104 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-31c3a0fb-8d73-4804-9af3-c302cb27a064 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:45.773634 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31c3a0fb-8d73-4804-9af3-c302cb27a064 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:45.774431 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31c3a0fb-8d73-4804-9af3-c302cb27a064 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:45.775125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31c3a0fb-8d73-4804-9af3-c302cb27a064 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:45.776696 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31c3a0fb-8d73-4804-9af3-c302cb27a064 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:45.777417 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31c3a0fb-8d73-4804-9af3-c302cb27a064 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:45.778132 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-31c3a0fb-8d73-4804-9af3-c302cb27a064 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:46.167878 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-31c3a0fb-8d73-4804-9af3-c302cb27a064 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:46.178376 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-31c3a0fb-8d73-4804-9af3-c302cb27a064 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.433273 Aug 29 20:35:46.178971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 189/369] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:45 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:46.258637 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:35:46.259210 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:35:46.259844 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:35:46.260964 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:35:46.261504 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:35:46.275572 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-631b9fd0-1099-4d30-a9ae-d99928569931 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:46.276884 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-631b9fd0-1099-4d30-a9ae-d99928569931 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:46.283967 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:46.284457 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:46.284893 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:46.285628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:46.289712 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-631b9fd0-1099-4d30-a9ae-d99928569931 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:46.290220 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-631b9fd0-1099-4d30-a9ae-d99928569931 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:46.290647 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-631b9fd0-1099-4d30-a9ae-d99928569931 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:46.291096 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:46.292194 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:46.297500 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-631b9fd0-1099-4d30-a9ae-d99928569931 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:46.297982 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-631b9fd0-1099-4d30-a9ae-d99928569931 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:46.298416 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-631b9fd0-1099-4d30-a9ae-d99928569931 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:46.333207 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Getting quotas for project 2f93e5b4f52b4b8cac7e0336a44b33ba. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:35:46.338252 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Getting quotas for user b93ff419d60043f0aab0c11a6abdaa38 and project 2f93e5b4f52b4b8cac7e0336a44b33ba. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:35:46.411893 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:35:46.414101 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='afb23680-6a9b-48a9-ab10-4c75d585b3e8',volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:35:46.475309 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-631b9fd0-1099-4d30-a9ae-d99928569931 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:46.488550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-631b9fd0-1099-4d30-a9ae-d99928569931 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.217616 Aug 29 20:35:46.489583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 190/370] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:46 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:46.589772 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0508908d-380f-4287-b86b-2dfdc909f96b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.153111 Aug 29 20:35:46.591670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 181/371] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:35:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:35:46.606133 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c8f17cdc-6013-4614-8aec-f30e04049389 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:46.607206 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c8f17cdc-6013-4614-8aec-f30e04049389 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:46.716331 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c8f17cdc-6013-4614-8aec-f30e04049389 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:46.724566 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c8f17cdc-6013-4614-8aec-f30e04049389 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1087 microversion: 2.1 time: 0.125837 Aug 29 20:35:46.725210 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 182/372] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:46 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1087 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:46.742653 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ce8b3b0b-2be8-4907-a2a0-0d2856146331 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:46.743314 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ce8b3b0b-2be8-4907-a2a0-0d2856146331 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:46.757765 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce8b3b0b-2be8-4907-a2a0-0d2856146331 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:46.758543 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce8b3b0b-2be8-4907-a2a0-0d2856146331 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:46.759370 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce8b3b0b-2be8-4907-a2a0-0d2856146331 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:46.760414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce8b3b0b-2be8-4907-a2a0-0d2856146331 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:46.761314 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce8b3b0b-2be8-4907-a2a0-0d2856146331 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:46.762385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ce8b3b0b-2be8-4907-a2a0-0d2856146331 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:46.838258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-327e7cce-c2a3-4b08-84c7-085fa3a70649 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Action: 'create', calling method: .version_select at 0x7f48635a6310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1635581417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6ZALxg+RjO2SbFHNYUjBa4pcxgW9ptfdmEerI6PAjJksUkjD1V+ZPBI9uxtPH2KfjMu0iiPPz4pt1ESM7K7zg0gi1ZGkDHOXc+ZuE8yUFJDiNzw4Usnx4h++sV9WpAhg=="}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:46.857013 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-327e7cce-c2a3-4b08-84c7-085fa3a70649 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Getting quotas for project 4ac573b4aa7a47c49d129afd9939e26d. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:35:46.861606 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-327e7cce-c2a3-4b08-84c7-085fa3a70649 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Getting quotas for user fca06f41184444ccb0ddb57e5d44f227 and project 4ac573b4aa7a47c49d129afd9939e26d. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:35:46.892934 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-327e7cce-c2a3-4b08-84c7-085fa3a70649 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.321501 Aug 29 20:35:46.896515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 191/373] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 29 20:35:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:35:46.966874 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ce8b3b0b-2be8-4907-a2a0-0d2856146331 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:46.976180 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ce8b3b0b-2be8-4907-a2a0-0d2856146331 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1504 microversion: 2.1 time: 0.242341 Aug 29 20:35:46.991723 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 183/374] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:46 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1504 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:47.204584 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2603580a-a928-432a-9a6b-7307aab33565 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:47.205216 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2603580a-a928-432a-9a6b-7307aab33565 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:47.213320 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2603580a-a928-432a-9a6b-7307aab33565 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:47.213859 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2603580a-a928-432a-9a6b-7307aab33565 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:47.214301 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2603580a-a928-432a-9a6b-7307aab33565 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:47.215255 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2603580a-a928-432a-9a6b-7307aab33565 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:47.215908 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2603580a-a928-432a-9a6b-7307aab33565 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:47.216822 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2603580a-a928-432a-9a6b-7307aab33565 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:47.458164 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2603580a-a928-432a-9a6b-7307aab33565 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:47.466413 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2603580a-a928-432a-9a6b-7307aab33565 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.270461 Aug 29 20:35:47.466993 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 192/375] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:47 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:47.515639 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ad8e467b-a6d4-431f-8541-4a13f446c3ea tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:47.516738 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ad8e467b-a6d4-431f-8541-4a13f446c3ea tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:47.525796 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad8e467b-a6d4-431f-8541-4a13f446c3ea tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:47.526665 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad8e467b-a6d4-431f-8541-4a13f446c3ea tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:47.527710 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad8e467b-a6d4-431f-8541-4a13f446c3ea tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:47.528927 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad8e467b-a6d4-431f-8541-4a13f446c3ea tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:47.529615 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad8e467b-a6d4-431f-8541-4a13f446c3ea tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:47.530752 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ad8e467b-a6d4-431f-8541-4a13f446c3ea tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:47.556268 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:47.762259 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e71982fc-2ba8-4b23-95ff-e85f1889488e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:47.769203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e71982fc-2ba8-4b23-95ff-e85f1889488e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:47.787430 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e71982fc-2ba8-4b23-95ff-e85f1889488e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:47.788336 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e71982fc-2ba8-4b23-95ff-e85f1889488e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:47.789012 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e71982fc-2ba8-4b23-95ff-e85f1889488e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:47.790210 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e71982fc-2ba8-4b23-95ff-e85f1889488e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:47.790990 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e71982fc-2ba8-4b23-95ff-e85f1889488e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:47.792199 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e71982fc-2ba8-4b23-95ff-e85f1889488e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:47.946339 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e71982fc-2ba8-4b23-95ff-e85f1889488e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:47.959058 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e71982fc-2ba8-4b23-95ff-e85f1889488e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1185 microversion: 2.1 time: 0.216731 Aug 29 20:35:47.960304 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 193/376] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:47 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1185 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:48.001108 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9e57e300-d328-4597-9892-4f479eb33a55 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:48.002313 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9e57e300-d328-4597-9892-4f479eb33a55 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:48.010030 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ad8e467b-a6d4-431f-8541-4a13f446c3ea tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:48.020869 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ad8e467b-a6d4-431f-8541-4a13f446c3ea tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.512924 Aug 29 20:35:48.022136 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 184/377] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:47 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:48.030121 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9e57e300-d328-4597-9892-4f479eb33a55 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:48.030949 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9e57e300-d328-4597-9892-4f479eb33a55 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:48.031606 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9e57e300-d328-4597-9892-4f479eb33a55 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:48.033471 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9e57e300-d328-4597-9892-4f479eb33a55 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:48.034561 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9e57e300-d328-4597-9892-4f479eb33a55 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:48.035504 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9e57e300-d328-4597-9892-4f479eb33a55 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:48.292366 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9e57e300-d328-4597-9892-4f479eb33a55 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:48.303276 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9e57e300-d328-4597-9892-4f479eb33a55 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1504 microversion: 2.1 time: 0.308079 Aug 29 20:35:48.305131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 194/378] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:47 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:48.489260 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0e4c25c7-cfdd-45d3-80e8-c8b22a22ea4a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:48.490100 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0e4c25c7-cfdd-45d3-80e8-c8b22a22ea4a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:48.503378 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e4c25c7-cfdd-45d3-80e8-c8b22a22ea4a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:48.503895 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e4c25c7-cfdd-45d3-80e8-c8b22a22ea4a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:48.504438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e4c25c7-cfdd-45d3-80e8-c8b22a22ea4a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:48.505177 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e4c25c7-cfdd-45d3-80e8-c8b22a22ea4a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:48.505630 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e4c25c7-cfdd-45d3-80e8-c8b22a22ea4a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:48.506237 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e4c25c7-cfdd-45d3-80e8-c8b22a22ea4a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:48.551729 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-62a04835-fcba-4f77-8ff1-ea21dde0693e req-18a14d5b-c3f9-4473-a843-75d6ebea4942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357d9e2a-8aa3-4f1b-92ab-0c4db7649f43", "name": "network-vif-deleted", "tag": "1e1cfa6b-3a3e-4dfe-b010-9376ec5e6023"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:48.564681 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-62a04835-fcba-4f77-8ff1-ea21dde0693e req-18a14d5b-c3f9-4473-a843-75d6ebea4942 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:48.565950 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-62a04835-fcba-4f77-8ff1-ea21dde0693e req-18a14d5b-c3f9-4473-a843-75d6ebea4942 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:48.576504 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-62a04835-fcba-4f77-8ff1-ea21dde0693e req-18a14d5b-c3f9-4473-a843-75d6ebea4942 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:48.594241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-62a04835-fcba-4f77-8ff1-ea21dde0693e req-18a14d5b-c3f9-4473-a843-75d6ebea4942 service nova] Creating event network-vif-deleted:1e1cfa6b-3a3e-4dfe-b010-9376ec5e6023 for instance 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 on hv-cinder-85426 Aug 29 20:35:48.600541 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-62a04835-fcba-4f77-8ff1-ea21dde0693e req-18a14d5b-c3f9-4473-a843-75d6ebea4942 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052422 Aug 29 20:35:48.604818 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 195/379] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:35:48.741765 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0e4c25c7-cfdd-45d3-80e8-c8b22a22ea4a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:48.750921 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0e4c25c7-cfdd-45d3-80e8-c8b22a22ea4a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.265415 Aug 29 20:35:48.751761 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 185/380] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:48 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:48.982338 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-65fca423-ea96-4430-893c-45d06bbacf50 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:48.983063 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-65fca423-ea96-4430-893c-45d06bbacf50 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:48.990071 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-65fca423-ea96-4430-893c-45d06bbacf50 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:48.990558 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-65fca423-ea96-4430-893c-45d06bbacf50 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:48.990994 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-65fca423-ea96-4430-893c-45d06bbacf50 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:48.991693 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-65fca423-ea96-4430-893c-45d06bbacf50 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:48.992179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-65fca423-ea96-4430-893c-45d06bbacf50 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:48.992849 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-65fca423-ea96-4430-893c-45d06bbacf50 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:49.050673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-77953800-1cbe-4cae-b9af-ce3a078c8086 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:49.051299 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-77953800-1cbe-4cae-b9af-ce3a078c8086 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:49.061231 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77953800-1cbe-4cae-b9af-ce3a078c8086 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:49.061734 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77953800-1cbe-4cae-b9af-ce3a078c8086 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:49.062173 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77953800-1cbe-4cae-b9af-ce3a078c8086 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:49.067674 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77953800-1cbe-4cae-b9af-ce3a078c8086 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:49.069891 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77953800-1cbe-4cae-b9af-ce3a078c8086 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:49.071488 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77953800-1cbe-4cae-b9af-ce3a078c8086 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:49.153234 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-65fca423-ea96-4430-893c-45d06bbacf50 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:49.192514 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-65fca423-ea96-4430-893c-45d06bbacf50 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1185 microversion: 2.1 time: 0.214994 Aug 29 20:35:49.193165 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 196/381] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:48 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1185 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:49.327458 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ac96505a-d46d-4f84-a6c2-fd2c09fd2390 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:49.328493 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ac96505a-d46d-4f84-a6c2-fd2c09fd2390 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:49.341891 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ac96505a-d46d-4f84-a6c2-fd2c09fd2390 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:49.342751 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ac96505a-d46d-4f84-a6c2-fd2c09fd2390 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:49.343411 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ac96505a-d46d-4f84-a6c2-fd2c09fd2390 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:49.350752 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ac96505a-d46d-4f84-a6c2-fd2c09fd2390 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:49.351507 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ac96505a-d46d-4f84-a6c2-fd2c09fd2390 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:49.352000 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ac96505a-d46d-4f84-a6c2-fd2c09fd2390 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:49.450982 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ac96505a-d46d-4f84-a6c2-fd2c09fd2390 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:49.455506 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ac96505a-d46d-4f84-a6c2-fd2c09fd2390 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:49.457618 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ac96505a-d46d-4f84-a6c2-fd2c09fd2390 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:49.458302 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-ac96505a-d46d-4f84-a6c2-fd2c09fd2390 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lazy-loading 'fault' on Instance uuid 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:35:49.509550 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-77953800-1cbe-4cae-b9af-ce3a078c8086 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:49.522962 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-77953800-1cbe-4cae-b9af-ce3a078c8086 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1370 microversion: 2.1 time: 0.480497 Aug 29 20:35:49.524011 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 186/382] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:49 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1370 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:49.530511 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-ac96505a-d46d-4f84-a6c2-fd2c09fd2390 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:49.543811 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ac96505a-d46d-4f84-a6c2-fd2c09fd2390 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1304 microversion: 2.1 time: 0.220760 Aug 29 20:35:49.544923 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 197/383] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:49 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1304 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:49.774543 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d6247d02-b288-4b29-836f-0bdd3e396899 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:49.775286 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d6247d02-b288-4b29-836f-0bdd3e396899 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:49.781757 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6247d02-b288-4b29-836f-0bdd3e396899 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:49.782237 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6247d02-b288-4b29-836f-0bdd3e396899 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:49.782672 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6247d02-b288-4b29-836f-0bdd3e396899 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:49.783432 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6247d02-b288-4b29-836f-0bdd3e396899 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:49.783919 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6247d02-b288-4b29-836f-0bdd3e396899 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:49.784372 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d6247d02-b288-4b29-836f-0bdd3e396899 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:49.922115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-d6247d02-b288-4b29-836f-0bdd3e396899 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:49.935212 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d6247d02-b288-4b29-836f-0bdd3e396899 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.166461 Aug 29 20:35:49.935845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 187/384] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:49 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:50.213512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-096aa273-2e16-412c-9258-34390d70520c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:50.214734 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-096aa273-2e16-412c-9258-34390d70520c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:50.230519 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-096aa273-2e16-412c-9258-34390d70520c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:50.231152 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-096aa273-2e16-412c-9258-34390d70520c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:50.231431 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-096aa273-2e16-412c-9258-34390d70520c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:50.232149 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-096aa273-2e16-412c-9258-34390d70520c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:50.232601 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-096aa273-2e16-412c-9258-34390d70520c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:50.233020 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-096aa273-2e16-412c-9258-34390d70520c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:50.358231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-096aa273-2e16-412c-9258-34390d70520c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:50.371684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-096aa273-2e16-412c-9258-34390d70520c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1203 microversion: 2.1 time: 0.161847 Aug 29 20:35:50.372245 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 198/385] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:50 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:50.546744 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-032eaf09-58c8-4086-9c7b-553bcecbf09e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:50.547956 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-032eaf09-58c8-4086-9c7b-553bcecbf09e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:50.553877 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-032eaf09-58c8-4086-9c7b-553bcecbf09e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:50.554366 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-032eaf09-58c8-4086-9c7b-553bcecbf09e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:50.554795 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-032eaf09-58c8-4086-9c7b-553bcecbf09e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:50.555493 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-032eaf09-58c8-4086-9c7b-553bcecbf09e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:50.556021 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-032eaf09-58c8-4086-9c7b-553bcecbf09e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:50.556403 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-032eaf09-58c8-4086-9c7b-553bcecbf09e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:50.568067 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-878ff7f4-10dd-4fe4-815a-bcd6f28e8793 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:50.568685 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-878ff7f4-10dd-4fe4-815a-bcd6f28e8793 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:50.578192 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-878ff7f4-10dd-4fe4-815a-bcd6f28e8793 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:50.579179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-878ff7f4-10dd-4fe4-815a-bcd6f28e8793 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:50.579831 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-878ff7f4-10dd-4fe4-815a-bcd6f28e8793 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:50.580861 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-878ff7f4-10dd-4fe4-815a-bcd6f28e8793 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:50.581791 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-878ff7f4-10dd-4fe4-815a-bcd6f28e8793 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:50.582755 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-878ff7f4-10dd-4fe4-815a-bcd6f28e8793 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:50.635029 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-878ff7f4-10dd-4fe4-815a-bcd6f28e8793 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:50.636430 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-878ff7f4-10dd-4fe4-815a-bcd6f28e8793 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:50.637988 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-878ff7f4-10dd-4fe4-815a-bcd6f28e8793 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:50.638693 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-878ff7f4-10dd-4fe4-815a-bcd6f28e8793 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lazy-loading 'fault' on Instance uuid 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:35:50.642756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=100 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:50.718996 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-878ff7f4-10dd-4fe4-815a-bcd6f28e8793 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:50.728915 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-878ff7f4-10dd-4fe4-815a-bcd6f28e8793 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1304 microversion: 2.1 time: 0.165478 Aug 29 20:35:50.730732 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 199/386] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:50 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1304 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:50.737712 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-032eaf09-58c8-4086-9c7b-553bcecbf09e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:50.757039 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-032eaf09-58c8-4086-9c7b-553bcecbf09e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1565 microversion: 2.1 time: 0.216739 Aug 29 20:35:50.758668 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 188/387] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:50 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1565 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:50.780741 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-fe3adf53-e4b4-42e2-942f-7f582513a830 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:50.781391 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-fe3adf53-e4b4-42e2-942f-7f582513a830 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:50.790692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fe3adf53-e4b4-42e2-942f-7f582513a830 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:50.791247 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fe3adf53-e4b4-42e2-942f-7f582513a830 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:50.792377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fe3adf53-e4b4-42e2-942f-7f582513a830 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:50.793115 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fe3adf53-e4b4-42e2-942f-7f582513a830 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:50.793566 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fe3adf53-e4b4-42e2-942f-7f582513a830 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:50.793989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fe3adf53-e4b4-42e2-942f-7f582513a830 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:50.902694 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-fe3adf53-e4b4-42e2-942f-7f582513a830 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125806 Aug 29 20:35:50.904416 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 200/388] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 29 20:35:50 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:50.962981 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-489d4f4d-2a33-41aa-82d7-8c86f67c736c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:50.964030 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-489d4f4d-2a33-41aa-82d7-8c86f67c736c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:50.981697 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-489d4f4d-2a33-41aa-82d7-8c86f67c736c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:50.982464 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-489d4f4d-2a33-41aa-82d7-8c86f67c736c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:50.982980 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-489d4f4d-2a33-41aa-82d7-8c86f67c736c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:50.987456 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-489d4f4d-2a33-41aa-82d7-8c86f67c736c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:50.988046 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-489d4f4d-2a33-41aa-82d7-8c86f67c736c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:50.988499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-489d4f4d-2a33-41aa-82d7-8c86f67c736c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:51.391774 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-c1a51e9f-9de7-4eb5-8e16-9c29ede3b5d3 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:51.392497 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-c1a51e9f-9de7-4eb5-8e16-9c29ede3b5d3 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:51.399890 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c1a51e9f-9de7-4eb5-8e16-9c29ede3b5d3 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:51.400753 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c1a51e9f-9de7-4eb5-8e16-9c29ede3b5d3 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:51.402037 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c1a51e9f-9de7-4eb5-8e16-9c29ede3b5d3 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:51.403029 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c1a51e9f-9de7-4eb5-8e16-9c29ede3b5d3 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:51.403561 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c1a51e9f-9de7-4eb5-8e16-9c29ede3b5d3 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:51.404111 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c1a51e9f-9de7-4eb5-8e16-9c29ede3b5d3 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:51.531340 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-489d4f4d-2a33-41aa-82d7-8c86f67c736c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:51.541684 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-489d4f4d-2a33-41aa-82d7-8c86f67c736c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.589222 Aug 29 20:35:51.542463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 189/389] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:50 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:51.613113 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-c1a51e9f-9de7-4eb5-8e16-9c29ede3b5d3 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:51.625068 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c1a51e9f-9de7-4eb5-8e16-9c29ede3b5d3 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1270 microversion: 2.1 time: 0.236063 Aug 29 20:35:51.625718 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 201/390] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:51 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:51.754419 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-47195f83-5fae-4fde-b8a0-356bf3e2c531 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:51.755370 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-47195f83-5fae-4fde-b8a0-356bf3e2c531 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:51.763625 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47195f83-5fae-4fde-b8a0-356bf3e2c531 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:51.764155 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47195f83-5fae-4fde-b8a0-356bf3e2c531 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:51.764598 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47195f83-5fae-4fde-b8a0-356bf3e2c531 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:51.765341 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47195f83-5fae-4fde-b8a0-356bf3e2c531 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:51.765938 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47195f83-5fae-4fde-b8a0-356bf3e2c531 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:51.766789 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47195f83-5fae-4fde-b8a0-356bf3e2c531 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:51.804853 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47195f83-5fae-4fde-b8a0-356bf3e2c531 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:51.806308 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47195f83-5fae-4fde-b8a0-356bf3e2c531 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:51.806747 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47195f83-5fae-4fde-b8a0-356bf3e2c531 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:51.807903 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-47195f83-5fae-4fde-b8a0-356bf3e2c531 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lazy-loading 'fault' on Instance uuid 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:35:51.880544 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-47195f83-5fae-4fde-b8a0-356bf3e2c531 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:51.892364 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-47195f83-5fae-4fde-b8a0-356bf3e2c531 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 200 len: 1304 microversion: 2.1 time: 0.144923 Aug 29 20:35:51.893529 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 190/391] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:51 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:52.278068 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-cb643327-b4c7-4956-83d0-b48d866525de req-f8deee00-88e3-45fa-98d2-8092177fbfee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36516f8-3de4-45fa-a124-83436dcfe1c1", "tag": "8ff3928a-585f-4fdd-9895-afd0c54f0e08"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:52.288322 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-cb643327-b4c7-4956-83d0-b48d866525de req-f8deee00-88e3-45fa-98d2-8092177fbfee service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:52.288943 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-cb643327-b4c7-4956-83d0-b48d866525de req-f8deee00-88e3-45fa-98d2-8092177fbfee service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:52.289373 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-cb643327-b4c7-4956-83d0-b48d866525de req-f8deee00-88e3-45fa-98d2-8092177fbfee service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:52.302547 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-cb643327-b4c7-4956-83d0-b48d866525de req-f8deee00-88e3-45fa-98d2-8092177fbfee service nova] Creating event network-changed:8ff3928a-585f-4fdd-9895-afd0c54f0e08 for instance f36516f8-3de4-45fa-a124-83436dcfe1c1 on hv-cinder-85426 Aug 29 20:35:52.309515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-cb643327-b4c7-4956-83d0-b48d866525de req-f8deee00-88e3-45fa-98d2-8092177fbfee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034404 Aug 29 20:35:52.310942 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 202/392] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:52.573189 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-84754631-2b84-4629-a7d7-56bc16873261 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:52.577805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-84754631-2b84-4629-a7d7-56bc16873261 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:52.580580 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-061ed286-5bde-41ed-9782-d935a2234654 req-60cd1d91-98ea-4cb0-8662-fd695d364bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64544993-4d2e-4125-9371-c55b598a4ab1", "tag": "85b94151-961e-4568-b1f6-9b9ec1883e9a"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:52.601250 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84754631-2b84-4629-a7d7-56bc16873261 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:52.601751 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84754631-2b84-4629-a7d7-56bc16873261 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:52.602562 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84754631-2b84-4629-a7d7-56bc16873261 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:52.602903 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84754631-2b84-4629-a7d7-56bc16873261 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:52.607094 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84754631-2b84-4629-a7d7-56bc16873261 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:52.607528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84754631-2b84-4629-a7d7-56bc16873261 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:52.611818 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-061ed286-5bde-41ed-9782-d935a2234654 req-60cd1d91-98ea-4cb0-8662-fd695d364bac service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:52.615602 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-061ed286-5bde-41ed-9782-d935a2234654 req-60cd1d91-98ea-4cb0-8662-fd695d364bac service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:52.616239 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-061ed286-5bde-41ed-9782-d935a2234654 req-60cd1d91-98ea-4cb0-8662-fd695d364bac service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:52.629182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-061ed286-5bde-41ed-9782-d935a2234654 req-60cd1d91-98ea-4cb0-8662-fd695d364bac service nova] Creating event network-changed:85b94151-961e-4568-b1f6-9b9ec1883e9a for instance 64544993-4d2e-4125-9371-c55b598a4ab1 on hv-cinder-85426 Aug 29 20:35:52.636192 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-061ed286-5bde-41ed-9782-d935a2234654 req-60cd1d91-98ea-4cb0-8662-fd695d364bac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069505 Aug 29 20:35:52.638017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 203/393] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:35:52.655409 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-fa94e02b-eb3b-439a-b90e-71966b44225e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:52.659168 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-fa94e02b-eb3b-439a-b90e-71966b44225e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:52.668179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fa94e02b-eb3b-439a-b90e-71966b44225e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:52.668758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fa94e02b-eb3b-439a-b90e-71966b44225e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:52.669267 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fa94e02b-eb3b-439a-b90e-71966b44225e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:52.670461 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fa94e02b-eb3b-439a-b90e-71966b44225e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:52.671005 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fa94e02b-eb3b-439a-b90e-71966b44225e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:52.671492 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fa94e02b-eb3b-439a-b90e-71966b44225e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:52.995366 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-84754631-2b84-4629-a7d7-56bc16873261 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:53.007249 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-84754631-2b84-4629-a7d7-56bc16873261 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.447034 Aug 29 20:35:53.011546 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 191/394] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:52 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:53.019817 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-29a7eef8-7870-4cc7-8a33-aff641998596 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:53.024714 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-29a7eef8-7870-4cc7-8a33-aff641998596 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:53.043283 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29a7eef8-7870-4cc7-8a33-aff641998596 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:53.044142 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29a7eef8-7870-4cc7-8a33-aff641998596 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:53.048512 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29a7eef8-7870-4cc7-8a33-aff641998596 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:53.049451 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29a7eef8-7870-4cc7-8a33-aff641998596 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:53.050073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29a7eef8-7870-4cc7-8a33-aff641998596 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:53.050645 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29a7eef8-7870-4cc7-8a33-aff641998596 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:53.081411 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-29a7eef8-7870-4cc7-8a33-aff641998596 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] HTTP exception thrown: Instance 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 could not be found. Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-29a7eef8-7870-4cc7-8a33-aff641998596 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Request method failure captured: Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 HTTP/1.1 Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSL4KuUJMpfTHW_zzK6q1Vx98Ly3v-1zz0FUZ8Iw-aoWCQNSRaqZXucvbQyNklgiATNONafZxKN7R20WgkZ0-K7SR694cqaVVevpnijKF6FnRB8bNtZSrLgxOVIOWRy-HPiKqrtFvnjHqfid-STQSaunkzAYSv7t5b98Pyz6bLHPwXY Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 1c85b91350b74daeab5ba89364b4578e Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesActionsTest-76226694 Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:35:53.083181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:35:53.084702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1c85b91350b74daeab5ba89364b4578e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1c85b91350b74daeab5ba89364b4578e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1c85b91350b74daeab5ba89364b4578e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1c85b91350b74daeab5ba89364b4578e"}]}] Aug 29 20:35:53.084702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-VolumesActionsTest-76226694 Aug 29 20:35:53.084702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 1c85b91350b74daeab5ba89364b4578e Aug 29 20:35:53.084702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesActionsTest-76226694 Aug 29 20:35:53.084702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-VolumesActionsTest-76226694-project Aug 29 20:35:53.084702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:35:53.084702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:35:53.084702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 93dd431edc40415295518d9d24fd94af Aug 29 20:35:53.084702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-VolumesActionsTest-76226694-project Aug 29 20:35:53.084702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:35:53.084702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 could not be found. Aug 29 20:35:53.084702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '357d9e2a-8aa3-4f1b-92ab-0c4db7649f43'} Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 could not be found. Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:35:53.085604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 could not be found. Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 could not be found. Aug 29 20:35:53.087028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:35:53.103895 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-29a7eef8-7870-4cc7-8a33-aff641998596 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Returning 404 to user: Instance 357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:35:53.103895 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-29a7eef8-7870-4cc7-8a33-aff641998596 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43" status: 404 len: 111 microversion: 2.1 time: 0.070481 Aug 29 20:35:53.103895 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 192/395] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:53 2022] GET /compute/v2.1/servers/357d9e2a-8aa3-4f1b-92ab-0c4db7649f43 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:35:53.228966 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-fa94e02b-eb3b-439a-b90e-71966b44225e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:53.234607 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1125279350", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "networks": [{"uuid": "03168a32-5f0e-4f8c-b2be-a70299b1ceb4"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:53.241540 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-fa94e02b-eb3b-439a-b90e-71966b44225e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1258 microversion: 2.1 time: 0.594891 Aug 29 20:35:53.252785 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 204/396] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:52 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1258 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:53.300655 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] validate_networks() for [('03168a32-5f0e-4f8c-b2be-a70299b1ceb4', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:35:53.866791 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:35:53.867223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:35:53.867720 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:35:53.868164 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:35:53.868839 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:35:53.878544 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:53.879216 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:53.879832 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:53.880803 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:53.881260 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:53.881686 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:53.898886 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Getting quotas for project 1c85b91350b74daeab5ba89364b4578e. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:35:53.903118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Getting quotas for user 93dd431edc40415295518d9d24fd94af and project 1c85b91350b74daeab5ba89364b4578e. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:35:53.912211 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:53.914902 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:35:53.917661 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:35:53.973942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8523ee6c-e490-4ec1-aedb-afc293ef3a07 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742661 Aug 29 20:35:53.979830 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 193/397] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:35:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:35:53.986475 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-bc9856f3-f6b8-49a8-91bb-2bb4b25dcb9f tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:53.987090 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-bc9856f3-f6b8-49a8-91bb-2bb4b25dcb9f tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:54.034916 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03dd28d8-7ec9-4733-89dc-8b8b6f9ece05 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:54.036209 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-03dd28d8-7ec9-4733-89dc-8b8b6f9ece05 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:54.043240 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03dd28d8-7ec9-4733-89dc-8b8b6f9ece05 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:54.043803 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03dd28d8-7ec9-4733-89dc-8b8b6f9ece05 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:54.044898 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03dd28d8-7ec9-4733-89dc-8b8b6f9ece05 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:54.045676 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03dd28d8-7ec9-4733-89dc-8b8b6f9ece05 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:54.046216 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03dd28d8-7ec9-4733-89dc-8b8b6f9ece05 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:54.046826 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03dd28d8-7ec9-4733-89dc-8b8b6f9ece05 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:54.084902 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-bc9856f3-f6b8-49a8-91bb-2bb4b25dcb9f tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:54.093268 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-bc9856f3-f6b8-49a8-91bb-2bb4b25dcb9f tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1214 microversion: 2.1 time: 0.110686 Aug 29 20:35:54.096839 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 205/398] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:53 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:54.263010 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9f8bc405-4b67-44a0-b180-ef1171725e88 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:54.263666 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9f8bc405-4b67-44a0-b180-ef1171725e88 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:54.276610 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9f8bc405-4b67-44a0-b180-ef1171725e88 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:54.277874 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9f8bc405-4b67-44a0-b180-ef1171725e88 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:54.281086 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9f8bc405-4b67-44a0-b180-ef1171725e88 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:54.282334 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9f8bc405-4b67-44a0-b180-ef1171725e88 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:54.283056 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9f8bc405-4b67-44a0-b180-ef1171725e88 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:54.283647 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9f8bc405-4b67-44a0-b180-ef1171725e88 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:54.588470 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9f8bc405-4b67-44a0-b180-ef1171725e88 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:54.601213 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9f8bc405-4b67-44a0-b180-ef1171725e88 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1258 microversion: 2.1 time: 0.342317 Aug 29 20:35:54.602693 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 206/399] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:54 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1258 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:54.773139 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-03dd28d8-7ec9-4733-89dc-8b8b6f9ece05 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:54.782620 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-03dd28d8-7ec9-4733-89dc-8b8b6f9ece05 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.754901 Aug 29 20:35:54.783181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 194/400] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:54 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:55.117051 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ca3c5989-cd35-42ba-bd07-940723b820ac tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:55.117666 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ca3c5989-cd35-42ba-bd07-940723b820ac tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:55.124381 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ca3c5989-cd35-42ba-bd07-940723b820ac tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:55.124865 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ca3c5989-cd35-42ba-bd07-940723b820ac tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:55.125291 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ca3c5989-cd35-42ba-bd07-940723b820ac tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:55.125984 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ca3c5989-cd35-42ba-bd07-940723b820ac tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:55.126429 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ca3c5989-cd35-42ba-bd07-940723b820ac tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:55.126845 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ca3c5989-cd35-42ba-bd07-940723b820ac tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:55.190506 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-ca3c5989-cd35-42ba-bd07-940723b820ac tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:55.198232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ca3c5989-cd35-42ba-bd07-940723b820ac tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1210 microversion: 2.1 time: 0.084968 Aug 29 20:35:55.198797 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 207/401] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:55 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:55.502086 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-13d0691c-570c-4403-aff7-294e3703b215 req-99715240-7372-4422-a3a6-a73285213ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68772d1-e335-4575-9654-313e27c49591", "name": "network-vif-plugged", "status": "completed", "tag": "d63c8d5b-2b84-4f67-944f-9f299a5aa8cb"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:55.512287 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-13d0691c-570c-4403-aff7-294e3703b215 req-99715240-7372-4422-a3a6-a73285213ce2 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:55.512759 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-13d0691c-570c-4403-aff7-294e3703b215 req-99715240-7372-4422-a3a6-a73285213ce2 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:55.513192 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-13d0691c-570c-4403-aff7-294e3703b215 req-99715240-7372-4422-a3a6-a73285213ce2 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:55.528928 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-13d0691c-570c-4403-aff7-294e3703b215 req-99715240-7372-4422-a3a6-a73285213ce2 service nova] Creating event network-vif-plugged:d63c8d5b-2b84-4f67-944f-9f299a5aa8cb for instance b68772d1-e335-4575-9654-313e27c49591 on hv-cinder-85426 Aug 29 20:35:55.535053 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-13d0691c-570c-4403-aff7-294e3703b215 req-99715240-7372-4422-a3a6-a73285213ce2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036628 Aug 29 20:35:55.535655 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 195/402] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:55.621487 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-0633e66e-0a76-44aa-9dd3-b34ed955bf83 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:55.622172 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-0633e66e-0a76-44aa-9dd3-b34ed955bf83 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:55.629564 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0633e66e-0a76-44aa-9dd3-b34ed955bf83 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:55.631275 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0633e66e-0a76-44aa-9dd3-b34ed955bf83 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:55.631716 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0633e66e-0a76-44aa-9dd3-b34ed955bf83 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:55.632497 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0633e66e-0a76-44aa-9dd3-b34ed955bf83 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:55.632991 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0633e66e-0a76-44aa-9dd3-b34ed955bf83 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:55.633443 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0633e66e-0a76-44aa-9dd3-b34ed955bf83 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:55.783798 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-0633e66e-0a76-44aa-9dd3-b34ed955bf83 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:55.793052 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-0633e66e-0a76-44aa-9dd3-b34ed955bf83 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1258 microversion: 2.1 time: 0.175236 Aug 29 20:35:55.793670 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 208/403] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:55 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:55.803751 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-17e22417-ab78-4f55-aedb-3c1ed75f1f51 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:55.804923 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-17e22417-ab78-4f55-aedb-3c1ed75f1f51 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:55.812831 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17e22417-ab78-4f55-aedb-3c1ed75f1f51 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:55.813312 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17e22417-ab78-4f55-aedb-3c1ed75f1f51 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:55.813919 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17e22417-ab78-4f55-aedb-3c1ed75f1f51 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:55.814777 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17e22417-ab78-4f55-aedb-3c1ed75f1f51 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:55.815227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17e22417-ab78-4f55-aedb-3c1ed75f1f51 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:55.815825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-17e22417-ab78-4f55-aedb-3c1ed75f1f51 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:55.967424 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-17e22417-ab78-4f55-aedb-3c1ed75f1f51 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:55.975109 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-17e22417-ab78-4f55-aedb-3c1ed75f1f51 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.176361 Aug 29 20:35:55.975667 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 196/404] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:55 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:56.219304 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f3e85f44-91ee-45c0-88c3-80dbabe1f30b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:56.219977 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-f3e85f44-91ee-45c0-88c3-80dbabe1f30b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:56.226425 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f3e85f44-91ee-45c0-88c3-80dbabe1f30b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:56.226917 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f3e85f44-91ee-45c0-88c3-80dbabe1f30b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:56.227355 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f3e85f44-91ee-45c0-88c3-80dbabe1f30b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:56.228182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f3e85f44-91ee-45c0-88c3-80dbabe1f30b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:56.228670 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f3e85f44-91ee-45c0-88c3-80dbabe1f30b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:56.229185 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f3e85f44-91ee-45c0-88c3-80dbabe1f30b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:56.294826 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-f3e85f44-91ee-45c0-88c3-80dbabe1f30b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:56.302502 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-f3e85f44-91ee-45c0-88c3-80dbabe1f30b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1266 microversion: 2.1 time: 0.086992 Aug 29 20:35:56.303066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 209/405] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:56 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:56.814990 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-95e00472-cfd7-4370-94e4-9d8bb9c5c372 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:56.815602 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-95e00472-cfd7-4370-94e4-9d8bb9c5c372 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:56.821712 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95e00472-cfd7-4370-94e4-9d8bb9c5c372 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:56.822193 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95e00472-cfd7-4370-94e4-9d8bb9c5c372 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:56.822630 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95e00472-cfd7-4370-94e4-9d8bb9c5c372 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:56.823323 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95e00472-cfd7-4370-94e4-9d8bb9c5c372 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:56.823779 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95e00472-cfd7-4370-94e4-9d8bb9c5c372 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:56.824238 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-95e00472-cfd7-4370-94e4-9d8bb9c5c372 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:56.957640 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-95e00472-cfd7-4370-94e4-9d8bb9c5c372 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:56.967780 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-95e00472-cfd7-4370-94e4-9d8bb9c5c372 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1258 microversion: 2.1 time: 0.156461 Aug 29 20:35:56.968641 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 197/406] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:56 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:56.998823 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-fb56c27f-02ec-4a5e-b132-704badc298bc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:56.999437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-fb56c27f-02ec-4a5e-b132-704badc298bc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:57.005972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fb56c27f-02ec-4a5e-b132-704badc298bc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:57.006451 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fb56c27f-02ec-4a5e-b132-704badc298bc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:57.006877 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fb56c27f-02ec-4a5e-b132-704badc298bc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:57.007557 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fb56c27f-02ec-4a5e-b132-704badc298bc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:57.008028 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fb56c27f-02ec-4a5e-b132-704badc298bc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:57.008446 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fb56c27f-02ec-4a5e-b132-704badc298bc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:57.160947 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-fb56c27f-02ec-4a5e-b132-704badc298bc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:57.172120 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-fb56c27f-02ec-4a5e-b132-704badc298bc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1358 microversion: 2.1 time: 0.179602 Aug 29 20:35:57.180163 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 210/407] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:56 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:57.324632 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0d2240d7-8976-446a-a7f6-1aeae292008e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:57.325211 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0d2240d7-8976-446a-a7f6-1aeae292008e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:57.332831 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2240d7-8976-446a-a7f6-1aeae292008e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:57.333729 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2240d7-8976-446a-a7f6-1aeae292008e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:57.334173 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2240d7-8976-446a-a7f6-1aeae292008e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:57.334896 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2240d7-8976-446a-a7f6-1aeae292008e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:57.335354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2240d7-8976-446a-a7f6-1aeae292008e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:57.335777 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0d2240d7-8976-446a-a7f6-1aeae292008e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:57.411698 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0d2240d7-8976-446a-a7f6-1aeae292008e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:57.420612 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0d2240d7-8976-446a-a7f6-1aeae292008e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1272 microversion: 2.1 time: 0.100015 Aug 29 20:35:57.421184 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 198/408] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:57 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:57.990589 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-73ea1248-6db3-45aa-ad79-4663eb0a4b43 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:57.991176 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-73ea1248-6db3-45aa-ad79-4663eb0a4b43 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:57.998146 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73ea1248-6db3-45aa-ad79-4663eb0a4b43 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:57.998620 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73ea1248-6db3-45aa-ad79-4663eb0a4b43 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:57.999048 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73ea1248-6db3-45aa-ad79-4663eb0a4b43 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:57.999723 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73ea1248-6db3-45aa-ad79-4663eb0a4b43 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:58.000197 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73ea1248-6db3-45aa-ad79-4663eb0a4b43 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:58.000610 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73ea1248-6db3-45aa-ad79-4663eb0a4b43 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:58.134889 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-73ea1248-6db3-45aa-ad79-4663eb0a4b43 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:58.144071 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-73ea1248-6db3-45aa-ad79-4663eb0a4b43 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1258 microversion: 2.1 time: 0.157173 Aug 29 20:35:58.144647 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 211/409] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:57 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:58.194624 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6a3b4cf0-d057-4680-9c4b-b8831e89b41c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:58.195403 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6a3b4cf0-d057-4680-9c4b-b8831e89b41c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:58.202394 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a3b4cf0-d057-4680-9c4b-b8831e89b41c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:58.202890 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a3b4cf0-d057-4680-9c4b-b8831e89b41c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:58.203327 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a3b4cf0-d057-4680-9c4b-b8831e89b41c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:58.204138 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a3b4cf0-d057-4680-9c4b-b8831e89b41c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:58.204607 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a3b4cf0-d057-4680-9c4b-b8831e89b41c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:58.205054 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a3b4cf0-d057-4680-9c4b-b8831e89b41c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:58.334426 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6a3b4cf0-d057-4680-9c4b-b8831e89b41c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:58.342736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6a3b4cf0-d057-4680-9c4b-b8831e89b41c tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1548 microversion: 2.1 time: 0.151954 Aug 29 20:35:58.343458 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 199/410] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:58 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:58.364970 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-df5738c0-c584-4167-9425-5565fc46a866 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:58.365590 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-df5738c0-c584-4167-9425-5565fc46a866 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:58.372419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-df5738c0-c584-4167-9425-5565fc46a866 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:58.372902 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-df5738c0-c584-4167-9425-5565fc46a866 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:58.373340 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-df5738c0-c584-4167-9425-5565fc46a866 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:58.374033 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-df5738c0-c584-4167-9425-5565fc46a866 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:58.374498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-df5738c0-c584-4167-9425-5565fc46a866 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:58.374920 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-df5738c0-c584-4167-9425-5565fc46a866 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:58.441729 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-289a6bf3-2204-4967-ba24-97b430eeea0a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:58.442262 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-289a6bf3-2204-4967-ba24-97b430eeea0a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:58.448227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-289a6bf3-2204-4967-ba24-97b430eeea0a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:58.448699 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-289a6bf3-2204-4967-ba24-97b430eeea0a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:58.449133 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-289a6bf3-2204-4967-ba24-97b430eeea0a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:58.449835 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-289a6bf3-2204-4967-ba24-97b430eeea0a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:58.450288 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-289a6bf3-2204-4967-ba24-97b430eeea0a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:58.450713 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-289a6bf3-2204-4967-ba24-97b430eeea0a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:58.507328 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-df5738c0-c584-4167-9425-5565fc46a866 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:58.517692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-df5738c0-c584-4167-9425-5565fc46a866 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1548 microversion: 2.1 time: 0.156455 Aug 29 20:35:58.519339 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 212/411] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:58 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:58.538522 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-be0776c3-b460-41a3-8e35-e21fd5ae2806 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:58.543982 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-be0776c3-b460-41a3-8e35-e21fd5ae2806 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:58.544730 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-be0776c3-b460-41a3-8e35-e21fd5ae2806 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Searching by: {'deleted': False, 'project_id': '3f36c1186e0f44df87d13ef836f6525b'} {{(pid=127027) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 20:35:58.551447 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-be0776c3-b460-41a3-8e35-e21fd5ae2806 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:58.551946 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-be0776c3-b460-41a3-8e35-e21fd5ae2806 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:58.552394 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-be0776c3-b460-41a3-8e35-e21fd5ae2806 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:58.553119 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-be0776c3-b460-41a3-8e35-e21fd5ae2806 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:58.553571 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-be0776c3-b460-41a3-8e35-e21fd5ae2806 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:58.553996 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-be0776c3-b460-41a3-8e35-e21fd5ae2806 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:58.645652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.multi_cell_list [None req-be0776c3-b460-41a3-8e35-e21fd5ae2806 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127027) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 20:35:58.661800 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-289a6bf3-2204-4967-ba24-97b430eeea0a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:58.670261 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-289a6bf3-2204-4967-ba24-97b430eeea0a tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1314 microversion: 2.1 time: 0.232788 Aug 29 20:35:58.670821 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 200/412] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:58 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:35:58.748949 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-be0776c3-b460-41a3-8e35-e21fd5ae2806 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.214297 Aug 29 20:35:58.749493 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 213/413] 10.222.0.18 () {58 vars in 1125 bytes} [Mon Aug 29 20:35:58 2022] GET /compute/v2.1/servers => generated 342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:35:58.762640 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cec6bc40-32b3-4db0-a01f-818d565ec3e1 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:58.763258 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cec6bc40-32b3-4db0-a01f-818d565ec3e1 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:58.769828 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec6bc40-32b3-4db0-a01f-818d565ec3e1 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:58.770708 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec6bc40-32b3-4db0-a01f-818d565ec3e1 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:58.771328 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec6bc40-32b3-4db0-a01f-818d565ec3e1 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:58.772430 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec6bc40-32b3-4db0-a01f-818d565ec3e1 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:58.772890 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec6bc40-32b3-4db0-a01f-818d565ec3e1 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:58.773315 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cec6bc40-32b3-4db0-a01f-818d565ec3e1 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:58.998467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-cec6bc40-32b3-4db0-a01f-818d565ec3e1 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:59.006208 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cec6bc40-32b3-4db0-a01f-818d565ec3e1 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1548 microversion: 2.1 time: 0.248135 Aug 29 20:35:59.006805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 201/414] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:58 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1548 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:59.165824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-59ebb132-1d32-40e0-af3d-45e8a3f0534a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:59.167278 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-59ebb132-1d32-40e0-af3d-45e8a3f0534a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:59.175816 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59ebb132-1d32-40e0-af3d-45e8a3f0534a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:59.176336 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59ebb132-1d32-40e0-af3d-45e8a3f0534a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:59.176988 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59ebb132-1d32-40e0-af3d-45e8a3f0534a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:59.177745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59ebb132-1d32-40e0-af3d-45e8a3f0534a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:59.178338 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59ebb132-1d32-40e0-af3d-45e8a3f0534a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:59.178926 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59ebb132-1d32-40e0-af3d-45e8a3f0534a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:59.278932 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-6a09263b-2bee-4219-9661-c9919934ff39 req-d597ea44-f26c-4ee4-9a7a-788e112c076c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "326327d5-cec9-4a20-9b94-84ef0fee670d", "tag": "8dc5eb97-a9d3-4521-a834-083bdafe6c20"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:35:59.314235 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6a09263b-2bee-4219-9661-c9919934ff39 req-d597ea44-f26c-4ee4-9a7a-788e112c076c service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:59.315339 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6a09263b-2bee-4219-9661-c9919934ff39 req-d597ea44-f26c-4ee4-9a7a-788e112c076c service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:59.315741 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-6a09263b-2bee-4219-9661-c9919934ff39 req-d597ea44-f26c-4ee4-9a7a-788e112c076c service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:59.347359 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-6a09263b-2bee-4219-9661-c9919934ff39 req-d597ea44-f26c-4ee4-9a7a-788e112c076c service nova] Creating event network-changed:8dc5eb97-a9d3-4521-a834-083bdafe6c20 for instance 326327d5-cec9-4a20-9b94-84ef0fee670d on hv-cinder-85426 Aug 29 20:35:59.371151 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-6a09263b-2bee-4219-9661-c9919934ff39 req-d597ea44-f26c-4ee4-9a7a-788e112c076c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096947 Aug 29 20:35:59.375722 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 202/415] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:35:59.389372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-59ebb132-1d32-40e0-af3d-45e8a3f0534a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:59.397719 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-59ebb132-1d32-40e0-af3d-45e8a3f0534a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1258 microversion: 2.1 time: 0.237032 Aug 29 20:35:59.398308 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 214/416] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:59 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1258 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:35:59.692229 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3c8f08a2-5196-4cbc-a549-40e94fdd98ec tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:35:59.692925 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3c8f08a2-5196-4cbc-a549-40e94fdd98ec tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:35:59.699258 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c8f08a2-5196-4cbc-a549-40e94fdd98ec tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:59.699741 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c8f08a2-5196-4cbc-a549-40e94fdd98ec tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:59.700428 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c8f08a2-5196-4cbc-a549-40e94fdd98ec tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:59.701137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c8f08a2-5196-4cbc-a549-40e94fdd98ec tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:35:59.701595 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c8f08a2-5196-4cbc-a549-40e94fdd98ec tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:35:59.702086 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c8f08a2-5196-4cbc-a549-40e94fdd98ec tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:35:59.720146 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:59.840493 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3c8f08a2-5196-4cbc-a549-40e94fdd98ec tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:35:59.848189 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3c8f08a2-5196-4cbc-a549-40e94fdd98ec tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1314 microversion: 2.1 time: 0.160595 Aug 29 20:35:59.848747 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 203/417] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:35:59 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:00.419775 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4e2b91d5-e444-4045-aa9d-c4e991dcec51 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:00.420410 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4e2b91d5-e444-4045-aa9d-c4e991dcec51 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:00.427094 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4e2b91d5-e444-4045-aa9d-c4e991dcec51 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:00.427579 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4e2b91d5-e444-4045-aa9d-c4e991dcec51 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:00.428214 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4e2b91d5-e444-4045-aa9d-c4e991dcec51 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:00.428912 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4e2b91d5-e444-4045-aa9d-c4e991dcec51 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:00.429366 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4e2b91d5-e444-4045-aa9d-c4e991dcec51 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:00.429780 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4e2b91d5-e444-4045-aa9d-c4e991dcec51 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:00.593429 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4e2b91d5-e444-4045-aa9d-c4e991dcec51 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:00.604764 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4e2b91d5-e444-4045-aa9d-c4e991dcec51 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1258 microversion: 2.1 time: 0.190587 Aug 29 20:36:00.609821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 215/418] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:00 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1258 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:00.655168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f909ef1f-b257-4664-aaa6-b2c1c70abc99 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfd75817-72d1-44f9-8aec-fde22a8addff"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:00.657678 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f909ef1f-b257-4664-aaa6-b2c1c70abc99 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:00.664237 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f909ef1f-b257-4664-aaa6-b2c1c70abc99 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:00.664722 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f909ef1f-b257-4664-aaa6-b2c1c70abc99 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:00.665245 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f909ef1f-b257-4664-aaa6-b2c1c70abc99 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:00.666147 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f909ef1f-b257-4664-aaa6-b2c1c70abc99 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:00.666469 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f909ef1f-b257-4664-aaa6-b2c1c70abc99 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:00.666937 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f909ef1f-b257-4664-aaa6-b2c1c70abc99 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:00.869434 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a1dfdf8a-37e8-408b-be58-6c7c265308c5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:00.870475 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a1dfdf8a-37e8-408b-be58-6c7c265308c5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:00.877338 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a1dfdf8a-37e8-408b-be58-6c7c265308c5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:00.877812 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a1dfdf8a-37e8-408b-be58-6c7c265308c5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:00.878249 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a1dfdf8a-37e8-408b-be58-6c7c265308c5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:00.878968 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a1dfdf8a-37e8-408b-be58-6c7c265308c5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:00.879428 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a1dfdf8a-37e8-408b-be58-6c7c265308c5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:00.879854 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a1dfdf8a-37e8-408b-be58-6c7c265308c5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:01.016165 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a1dfdf8a-37e8-408b-be58-6c7c265308c5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:01.029174 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a1dfdf8a-37e8-408b-be58-6c7c265308c5 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1314 microversion: 2.1 time: 0.163622 Aug 29 20:36:01.029954 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 216/419] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:00 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:01.629322 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-29933f18-13f6-4431-96b2-796bf5d828a5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:01.630221 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-29933f18-13f6-4431-96b2-796bf5d828a5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:01.640795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-29933f18-13f6-4431-96b2-796bf5d828a5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:01.641521 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-29933f18-13f6-4431-96b2-796bf5d828a5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:01.642041 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-29933f18-13f6-4431-96b2-796bf5d828a5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:01.642843 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-29933f18-13f6-4431-96b2-796bf5d828a5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:01.643395 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-29933f18-13f6-4431-96b2-796bf5d828a5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:01.643912 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-29933f18-13f6-4431-96b2-796bf5d828a5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:01.781085 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-29933f18-13f6-4431-96b2-796bf5d828a5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:01.788742 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-29933f18-13f6-4431-96b2-796bf5d828a5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1258 microversion: 2.1 time: 0.164798 Aug 29 20:36:01.789293 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 217/420] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:01 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:02.049957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4e84d76a-0ad5-4e3b-8b80-9950e07f8e9c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:02.050595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4e84d76a-0ad5-4e3b-8b80-9950e07f8e9c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:02.056538 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4e84d76a-0ad5-4e3b-8b80-9950e07f8e9c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:02.057018 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4e84d76a-0ad5-4e3b-8b80-9950e07f8e9c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:02.058090 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4e84d76a-0ad5-4e3b-8b80-9950e07f8e9c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:02.058779 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4e84d76a-0ad5-4e3b-8b80-9950e07f8e9c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:02.059496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4e84d76a-0ad5-4e3b-8b80-9950e07f8e9c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:02.059918 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4e84d76a-0ad5-4e3b-8b80-9950e07f8e9c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:02.082111 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=100 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:02.195114 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4e84d76a-0ad5-4e3b-8b80-9950e07f8e9c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:02.202746 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4e84d76a-0ad5-4e3b-8b80-9950e07f8e9c tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1314 microversion: 2.1 time: 0.156832 Aug 29 20:36:02.203303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 218/421] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:02 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:02.698636 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f909ef1f-b257-4664-aaa6-b2c1c70abc99 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "POST /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.047811 Aug 29 20:36:02.699823 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 204/422] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 29 20:36:00 2022] POST /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/os-volume_attachments => generated 194 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:02.810115 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-bc270489-7594-4793-9ebf-9e846444ecfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:02.810728 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-bc270489-7594-4793-9ebf-9e846444ecfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:02.813057 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:02.818631 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc270489-7594-4793-9ebf-9e846444ecfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:02.819111 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc270489-7594-4793-9ebf-9e846444ecfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:02.819545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc270489-7594-4793-9ebf-9e846444ecfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:02.820275 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc270489-7594-4793-9ebf-9e846444ecfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:02.820814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc270489-7594-4793-9ebf-9e846444ecfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:02.822302 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc270489-7594-4793-9ebf-9e846444ecfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:02.965369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-bc270489-7594-4793-9ebf-9e846444ecfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:02.973542 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-bc270489-7594-4793-9ebf-9e846444ecfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1258 microversion: 2.1 time: 0.168177 Aug 29 20:36:02.974107 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 219/423] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:02 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:03.223819 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-30f78f1e-1cce-4868-87a0-c63fc0b55863 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:03.224533 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-30f78f1e-1cce-4868-87a0-c63fc0b55863 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:03.231808 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30f78f1e-1cce-4868-87a0-c63fc0b55863 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:03.232353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30f78f1e-1cce-4868-87a0-c63fc0b55863 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:03.232792 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30f78f1e-1cce-4868-87a0-c63fc0b55863 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:03.233489 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30f78f1e-1cce-4868-87a0-c63fc0b55863 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:03.233942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30f78f1e-1cce-4868-87a0-c63fc0b55863 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:03.234478 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-30f78f1e-1cce-4868-87a0-c63fc0b55863 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:03.380058 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-30f78f1e-1cce-4868-87a0-c63fc0b55863 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:03.388253 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-30f78f1e-1cce-4868-87a0-c63fc0b55863 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1314 microversion: 2.1 time: 0.168795 Aug 29 20:36:03.388782 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 205/424] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:03 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:03.820880 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-1f88a9b7-79f8-416e-91a0-b4b5b87dc91f req-14e862d0-8666-4036-ae00-3855e32648eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36516f8-3de4-45fa-a124-83436dcfe1c1", "name": "network-vif-plugged", "status": "completed", "tag": "8ff3928a-585f-4fdd-9895-afd0c54f0e08"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:03.831657 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-1f88a9b7-79f8-416e-91a0-b4b5b87dc91f req-14e862d0-8666-4036-ae00-3855e32648eb service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:03.832179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-1f88a9b7-79f8-416e-91a0-b4b5b87dc91f req-14e862d0-8666-4036-ae00-3855e32648eb service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:03.832703 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-1f88a9b7-79f8-416e-91a0-b4b5b87dc91f req-14e862d0-8666-4036-ae00-3855e32648eb service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:03.845996 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-1f88a9b7-79f8-416e-91a0-b4b5b87dc91f req-14e862d0-8666-4036-ae00-3855e32648eb service nova] Creating event network-vif-plugged:8ff3928a-585f-4fdd-9895-afd0c54f0e08 for instance f36516f8-3de4-45fa-a124-83436dcfe1c1 on hv-cinder-85426 Aug 29 20:36:03.851025 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-1f88a9b7-79f8-416e-91a0-b4b5b87dc91f req-14e862d0-8666-4036-ae00-3855e32648eb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033996 Aug 29 20:36:03.851800 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 220/425] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:36:03.995278 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-24f8a022-fd1c-466b-932d-00fc8dc45bb5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:03.995985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-24f8a022-fd1c-466b-932d-00fc8dc45bb5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:03.998391 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:03.999058 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=14 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:04.005212 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24f8a022-fd1c-466b-932d-00fc8dc45bb5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:04.005691 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24f8a022-fd1c-466b-932d-00fc8dc45bb5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:04.006118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24f8a022-fd1c-466b-932d-00fc8dc45bb5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:04.006808 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24f8a022-fd1c-466b-932d-00fc8dc45bb5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:04.007254 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24f8a022-fd1c-466b-932d-00fc8dc45bb5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:04.007668 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24f8a022-fd1c-466b-932d-00fc8dc45bb5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:04.153662 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-24f8a022-fd1c-466b-932d-00fc8dc45bb5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:04.161630 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-24f8a022-fd1c-466b-932d-00fc8dc45bb5 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1258 microversion: 2.1 time: 0.170787 Aug 29 20:36:04.162329 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 206/426] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:03 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:04.413597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-79b60f3c-dbca-4007-916b-c1d6058c27b1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:04.414210 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-79b60f3c-dbca-4007-916b-c1d6058c27b1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:04.416190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=6 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:04.421804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-79b60f3c-dbca-4007-916b-c1d6058c27b1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:04.422290 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-79b60f3c-dbca-4007-916b-c1d6058c27b1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:04.422750 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-79b60f3c-dbca-4007-916b-c1d6058c27b1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:04.423452 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-79b60f3c-dbca-4007-916b-c1d6058c27b1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:04.423906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-79b60f3c-dbca-4007-916b-c1d6058c27b1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:04.424354 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-79b60f3c-dbca-4007-916b-c1d6058c27b1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:04.562886 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-79b60f3c-dbca-4007-916b-c1d6058c27b1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:04.572090 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-79b60f3c-dbca-4007-916b-c1d6058c27b1 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1314 microversion: 2.1 time: 0.162712 Aug 29 20:36:04.572713 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 221/427] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:04 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:05.183172 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-953455f2-5bfd-44b4-a498-8996927329f8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:05.183788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-953455f2-5bfd-44b4-a498-8996927329f8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:05.190245 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-953455f2-5bfd-44b4-a498-8996927329f8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:05.190722 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-953455f2-5bfd-44b4-a498-8996927329f8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:05.191150 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-953455f2-5bfd-44b4-a498-8996927329f8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:05.191834 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-953455f2-5bfd-44b4-a498-8996927329f8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:05.192303 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-953455f2-5bfd-44b4-a498-8996927329f8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:05.192721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-953455f2-5bfd-44b4-a498-8996927329f8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:05.329501 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-953455f2-5bfd-44b4-a498-8996927329f8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:05.337289 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-953455f2-5bfd-44b4-a498-8996927329f8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1258 microversion: 2.1 time: 0.158585 Aug 29 20:36:05.337847 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 207/428] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:05 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:05.592957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-3d9dded4-55f4-4c77-9445-dedf4ab8a16e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:05.593585 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-3d9dded4-55f4-4c77-9445-dedf4ab8a16e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:05.599978 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3d9dded4-55f4-4c77-9445-dedf4ab8a16e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:05.600475 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3d9dded4-55f4-4c77-9445-dedf4ab8a16e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:05.600915 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3d9dded4-55f4-4c77-9445-dedf4ab8a16e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:05.601611 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3d9dded4-55f4-4c77-9445-dedf4ab8a16e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:05.602067 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3d9dded4-55f4-4c77-9445-dedf4ab8a16e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:05.602489 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3d9dded4-55f4-4c77-9445-dedf4ab8a16e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:05.744143 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-3d9dded4-55f4-4c77-9445-dedf4ab8a16e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:05.754190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-3d9dded4-55f4-4c77-9445-dedf4ab8a16e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1314 microversion: 2.1 time: 0.164938 Aug 29 20:36:05.754766 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 222/429] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:05 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:05.872243 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-e8e819b7-d260-4f67-8be8-8603c084d0c4 req-11e401af-77e1-476a-a3c0-458759e736a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "326327d5-cec9-4a20-9b94-84ef0fee670d", "name": "network-vif-plugged", "status": "completed", "tag": "8dc5eb97-a9d3-4521-a834-083bdafe6c20"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:05.883360 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e8e819b7-d260-4f67-8be8-8603c084d0c4 req-11e401af-77e1-476a-a3c0-458759e736a3 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:05.883842 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e8e819b7-d260-4f67-8be8-8603c084d0c4 req-11e401af-77e1-476a-a3c0-458759e736a3 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:05.884309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-e8e819b7-d260-4f67-8be8-8603c084d0c4 req-11e401af-77e1-476a-a3c0-458759e736a3 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:05.895742 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-e8e819b7-d260-4f67-8be8-8603c084d0c4 req-11e401af-77e1-476a-a3c0-458759e736a3 service nova] Creating event network-vif-plugged:8dc5eb97-a9d3-4521-a834-083bdafe6c20 for instance 326327d5-cec9-4a20-9b94-84ef0fee670d on hv-cinder-85426 Aug 29 20:36:05.901071 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-e8e819b7-d260-4f67-8be8-8603c084d0c4 req-11e401af-77e1-476a-a3c0-458759e736a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032540 Aug 29 20:36:05.901663 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 208/430] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:06.358598 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-33d7b9c6-afee-4631-8e28-d27fffe9793a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:06.359135 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-33d7b9c6-afee-4631-8e28-d27fffe9793a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:06.365124 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-33d7b9c6-afee-4631-8e28-d27fffe9793a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:06.365601 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-33d7b9c6-afee-4631-8e28-d27fffe9793a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:06.366034 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-33d7b9c6-afee-4631-8e28-d27fffe9793a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:06.366747 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-33d7b9c6-afee-4631-8e28-d27fffe9793a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:06.367194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-33d7b9c6-afee-4631-8e28-d27fffe9793a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:06.367613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-33d7b9c6-afee-4631-8e28-d27fffe9793a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:06.520257 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-33d7b9c6-afee-4631-8e28-d27fffe9793a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:06.528655 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-33d7b9c6-afee-4631-8e28-d27fffe9793a tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1258 microversion: 2.1 time: 0.174056 Aug 29 20:36:06.529234 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 223/431] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:06 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:06.775891 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0cd93a12-22cd-4efc-a854-7b033c46debe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:06.776627 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0cd93a12-22cd-4efc-a854-7b033c46debe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:06.782890 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cd93a12-22cd-4efc-a854-7b033c46debe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:06.783373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cd93a12-22cd-4efc-a854-7b033c46debe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:06.783804 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cd93a12-22cd-4efc-a854-7b033c46debe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:06.784531 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cd93a12-22cd-4efc-a854-7b033c46debe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:06.784979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cd93a12-22cd-4efc-a854-7b033c46debe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:06.785398 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0cd93a12-22cd-4efc-a854-7b033c46debe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:06.926598 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0cd93a12-22cd-4efc-a854-7b033c46debe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:06.934635 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0cd93a12-22cd-4efc-a854-7b033c46debe tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1314 microversion: 2.1 time: 0.163213 Aug 29 20:36:06.940331 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 209/432] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:06 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:07.550595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-5229a25b-4da6-4cb7-a8a9-7fc173c40599 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:07.551206 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-5229a25b-4da6-4cb7-a8a9-7fc173c40599 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:07.558397 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5229a25b-4da6-4cb7-a8a9-7fc173c40599 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:07.558817 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5229a25b-4da6-4cb7-a8a9-7fc173c40599 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:07.559496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5229a25b-4da6-4cb7-a8a9-7fc173c40599 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:07.560221 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5229a25b-4da6-4cb7-a8a9-7fc173c40599 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:07.560678 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5229a25b-4da6-4cb7-a8a9-7fc173c40599 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:07.561194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5229a25b-4da6-4cb7-a8a9-7fc173c40599 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:07.705914 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-5229a25b-4da6-4cb7-a8a9-7fc173c40599 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:07.714012 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-5229a25b-4da6-4cb7-a8a9-7fc173c40599 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1441 microversion: 2.1 time: 0.167672 Aug 29 20:36:07.714577 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 224/433] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:07 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1441 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:07.734141 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-14194729-2de4-4d08-a458-e0f8129577e4 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:07.734787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-14194729-2de4-4d08-a458-e0f8129577e4 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:07.740805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14194729-2de4-4d08-a458-e0f8129577e4 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:07.741287 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14194729-2de4-4d08-a458-e0f8129577e4 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:07.741724 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14194729-2de4-4d08-a458-e0f8129577e4 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:07.742442 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14194729-2de4-4d08-a458-e0f8129577e4 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:07.742903 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14194729-2de4-4d08-a458-e0f8129577e4 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:07.743329 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-14194729-2de4-4d08-a458-e0f8129577e4 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:07.882940 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-14194729-2de4-4d08-a458-e0f8129577e4 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:07.893008 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-14194729-2de4-4d08-a458-e0f8129577e4 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1441 microversion: 2.1 time: 0.162578 Aug 29 20:36:07.893588 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 210/434] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:07 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1441 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:07.954748 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b01ca1d2-59eb-4d16-8c41-cd4c0684449e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:07.955356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b01ca1d2-59eb-4d16-8c41-cd4c0684449e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:07.961275 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b01ca1d2-59eb-4d16-8c41-cd4c0684449e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:07.961751 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b01ca1d2-59eb-4d16-8c41-cd4c0684449e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:07.962182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b01ca1d2-59eb-4d16-8c41-cd4c0684449e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:07.962878 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b01ca1d2-59eb-4d16-8c41-cd4c0684449e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:07.963362 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b01ca1d2-59eb-4d16-8c41-cd4c0684449e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:07.963786 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b01ca1d2-59eb-4d16-8c41-cd4c0684449e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:08.116062 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b01ca1d2-59eb-4d16-8c41-cd4c0684449e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:08.124846 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b01ca1d2-59eb-4d16-8c41-cd4c0684449e tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1314 microversion: 2.1 time: 0.173882 Aug 29 20:36:08.125455 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 225/435] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:07 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:09.146048 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-96ef7dfc-87e7-49fc-918b-e40934a218e3 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:09.146715 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-96ef7dfc-87e7-49fc-918b-e40934a218e3 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:09.153694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96ef7dfc-87e7-49fc-918b-e40934a218e3 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:09.154176 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96ef7dfc-87e7-49fc-918b-e40934a218e3 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:09.154666 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96ef7dfc-87e7-49fc-918b-e40934a218e3 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:09.155302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96ef7dfc-87e7-49fc-918b-e40934a218e3 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:09.155751 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96ef7dfc-87e7-49fc-918b-e40934a218e3 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:09.156191 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-96ef7dfc-87e7-49fc-918b-e40934a218e3 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:09.375141 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-96ef7dfc-87e7-49fc-918b-e40934a218e3 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:09.385202 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-96ef7dfc-87e7-49fc-918b-e40934a218e3 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1498 microversion: 2.1 time: 0.243039 Aug 29 20:36:09.386546 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 211/436] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:09 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1498 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:10.183318 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-41409783-9067-4f93-8edd-728f765987d0 req-d2a45152-25e5-40ee-92e2-fec6dd5f90dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36516f8-3de4-45fa-a124-83436dcfe1c1", "tag": "8ff3928a-585f-4fdd-9895-afd0c54f0e08"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:10.190368 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:10.197163 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-41409783-9067-4f93-8edd-728f765987d0 req-d2a45152-25e5-40ee-92e2-fec6dd5f90dc service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:10.198816 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-41409783-9067-4f93-8edd-728f765987d0 req-d2a45152-25e5-40ee-92e2-fec6dd5f90dc service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:10.199435 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-41409783-9067-4f93-8edd-728f765987d0 req-d2a45152-25e5-40ee-92e2-fec6dd5f90dc service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:10.211744 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-41409783-9067-4f93-8edd-728f765987d0 req-d2a45152-25e5-40ee-92e2-fec6dd5f90dc service nova] Creating event network-changed:8ff3928a-585f-4fdd-9895-afd0c54f0e08 for instance f36516f8-3de4-45fa-a124-83436dcfe1c1 on hv-cinder-85426 Aug 29 20:36:10.217868 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-41409783-9067-4f93-8edd-728f765987d0 req-d2a45152-25e5-40ee-92e2-fec6dd5f90dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038627 Aug 29 20:36:10.221814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 226/437] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:36:10.302935 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b5f48309-119b-498c-b5ea-7d5cdc82d971 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:10.303809 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b5f48309-119b-498c-b5ea-7d5cdc82d971 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:10.313658 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5f48309-119b-498c-b5ea-7d5cdc82d971 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:10.314436 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5f48309-119b-498c-b5ea-7d5cdc82d971 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:10.314782 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5f48309-119b-498c-b5ea-7d5cdc82d971 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:10.315635 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5f48309-119b-498c-b5ea-7d5cdc82d971 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:10.316228 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5f48309-119b-498c-b5ea-7d5cdc82d971 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:10.316759 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5f48309-119b-498c-b5ea-7d5cdc82d971 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:10.347766 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b5f48309-119b-498c-b5ea-7d5cdc82d971 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:36:10.428550 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b5f48309-119b-498c-b5ea-7d5cdc82d971 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "DELETE /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 204 len: 0 microversion: 2.1 time: 0.131395 Aug 29 20:36:10.432381 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 212/438] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:36:10 2022] DELETE /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:36:10.439074 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-805e8407-2396-4bb4-a1b9-86846e6d90f2 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:10.440535 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-805e8407-2396-4bb4-a1b9-86846e6d90f2 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:10.449660 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-805e8407-2396-4bb4-a1b9-86846e6d90f2 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:10.450172 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-805e8407-2396-4bb4-a1b9-86846e6d90f2 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:10.450616 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-805e8407-2396-4bb4-a1b9-86846e6d90f2 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:10.451478 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-805e8407-2396-4bb4-a1b9-86846e6d90f2 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:10.452594 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-805e8407-2396-4bb4-a1b9-86846e6d90f2 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:10.453072 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-805e8407-2396-4bb4-a1b9-86846e6d90f2 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:10.596580 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-805e8407-2396-4bb4-a1b9-86846e6d90f2 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:10.605658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-805e8407-2396-4bb4-a1b9-86846e6d90f2 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1504 microversion: 2.1 time: 0.171124 Aug 29 20:36:10.606646 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 227/439] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:10 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:11.209493 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1517138470", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1635581417", "security_groups": [{"name": "tempest-secgroup-smoke-403245879"}], "block_device_mapping_v2": [{"uuid": "8eed41f4-8293-4e2f-ac7b-87ef37ec8ccf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6506ef9d-c593-4e22-ac07-3e14f3411bf3"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:11.348375 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] validate_networks() for [('6506ef9d-c593-4e22-ac07-3e14f3411bf3', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:36:11.629274 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6612bf44-db9e-45b0-972a-8697e93211bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:11.629935 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6612bf44-db9e-45b0-972a-8697e93211bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:11.636426 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6612bf44-db9e-45b0-972a-8697e93211bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:11.636902 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6612bf44-db9e-45b0-972a-8697e93211bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:11.637325 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6612bf44-db9e-45b0-972a-8697e93211bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:11.638006 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6612bf44-db9e-45b0-972a-8697e93211bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:11.638452 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6612bf44-db9e-45b0-972a-8697e93211bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:11.638860 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6612bf44-db9e-45b0-972a-8697e93211bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:11.727318 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:36:11.727741 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:36:11.728317 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:36:11.728728 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:36:11.729742 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:36:11.738645 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:11.739123 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:11.739551 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:11.740332 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:11.740783 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:11.741203 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:11.758213 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Getting quotas for project 4ac573b4aa7a47c49d129afd9939e26d. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:36:11.762214 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Getting quotas for user fca06f41184444ccb0ddb57e5d44f227 and project 4ac573b4aa7a47c49d129afd9939e26d. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:36:11.773960 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-6612bf44-db9e-45b0-972a-8697e93211bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:11.782294 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6612bf44-db9e-45b0-972a-8697e93211bf tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1504 microversion: 2.1 time: 0.156988 Aug 29 20:36:11.782856 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 228/440] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:11 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:11.819408 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:36:11.821902 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8eed41f4-8293-4e2f-ac7b-87ef37ec8ccf',volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:36:11.948725 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3bd9bb28-14e2-4424-84f9-457d00e287f4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.743563 Aug 29 20:36:11.949350 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 213/441] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:36:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:36:11.960139 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-fc79cb04-7a87-446b-a949-59963d5aad00 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:11.960881 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-fc79cb04-7a87-446b-a949-59963d5aad00 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:12.015270 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-fc79cb04-7a87-446b-a949-59963d5aad00 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:12.022209 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-fc79cb04-7a87-446b-a949-59963d5aad00 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1095 microversion: 2.1 time: 0.066057 Aug 29 20:36:12.023424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 229/442] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:11 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:12.804690 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ba79433f-abdd-4021-a64b-87a8f61247cd tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:12.805385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ba79433f-abdd-4021-a64b-87a8f61247cd tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:12.813224 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba79433f-abdd-4021-a64b-87a8f61247cd tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:12.813724 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba79433f-abdd-4021-a64b-87a8f61247cd tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:12.814160 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba79433f-abdd-4021-a64b-87a8f61247cd tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:12.814850 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba79433f-abdd-4021-a64b-87a8f61247cd tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:12.815351 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba79433f-abdd-4021-a64b-87a8f61247cd tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:12.815847 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ba79433f-abdd-4021-a64b-87a8f61247cd tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:12.951679 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ba79433f-abdd-4021-a64b-87a8f61247cd tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:12.959687 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ba79433f-abdd-4021-a64b-87a8f61247cd tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1504 microversion: 2.1 time: 0.159678 Aug 29 20:36:12.960286 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 214/443] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:12 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:13.044384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-c3c0b93f-341d-4e77-8191-dcf6d8794cde tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:13.045168 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-c3c0b93f-341d-4e77-8191-dcf6d8794cde tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:13.054528 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c3c0b93f-341d-4e77-8191-dcf6d8794cde tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:13.055426 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c3c0b93f-341d-4e77-8191-dcf6d8794cde tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:13.056045 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c3c0b93f-341d-4e77-8191-dcf6d8794cde tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:13.057290 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c3c0b93f-341d-4e77-8191-dcf6d8794cde tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:13.058471 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c3c0b93f-341d-4e77-8191-dcf6d8794cde tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:13.059050 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c3c0b93f-341d-4e77-8191-dcf6d8794cde tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:13.144293 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-c3c0b93f-341d-4e77-8191-dcf6d8794cde tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:13.153646 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c3c0b93f-341d-4e77-8191-dcf6d8794cde tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1137 microversion: 2.1 time: 0.113757 Aug 29 20:36:13.154632 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 230/444] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:13 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1137 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:13.595078 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8943ec69-f92f-432b-94db-93699e726466 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:13.595691 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8943ec69-f92f-432b-94db-93699e726466 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:13.602035 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8943ec69-f92f-432b-94db-93699e726466 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:13.602515 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8943ec69-f92f-432b-94db-93699e726466 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:13.602956 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8943ec69-f92f-432b-94db-93699e726466 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:13.604004 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8943ec69-f92f-432b-94db-93699e726466 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:13.604507 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8943ec69-f92f-432b-94db-93699e726466 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:13.604911 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8943ec69-f92f-432b-94db-93699e726466 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:13.833509 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8943ec69-f92f-432b-94db-93699e726466 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:13.841792 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8943ec69-f92f-432b-94db-93699e726466 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1594 microversion: 2.1 time: 0.250721 Aug 29 20:36:13.842901 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 215/445] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:13 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1594 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:13.987842 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e54b159c-3962-46cb-b93c-afd6f9e03446 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:13.988677 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e54b159c-3962-46cb-b93c-afd6f9e03446 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:14.005320 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e54b159c-3962-46cb-b93c-afd6f9e03446 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:14.005812 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e54b159c-3962-46cb-b93c-afd6f9e03446 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:14.006253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e54b159c-3962-46cb-b93c-afd6f9e03446 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:14.006968 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e54b159c-3962-46cb-b93c-afd6f9e03446 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:14.007425 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e54b159c-3962-46cb-b93c-afd6f9e03446 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:14.007846 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e54b159c-3962-46cb-b93c-afd6f9e03446 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:14.068983 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-067e1205-3169-4d9f-96b9-e7489f88f76b req-15ef873f-b2bc-4e18-ab4c-6131b6f028fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "326327d5-cec9-4a20-9b94-84ef0fee670d", "name": "network-vif-deleted", "tag": "8dc5eb97-a9d3-4521-a834-083bdafe6c20"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:14.085798 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-067e1205-3169-4d9f-96b9-e7489f88f76b req-15ef873f-b2bc-4e18-ab4c-6131b6f028fd service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:14.086309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-067e1205-3169-4d9f-96b9-e7489f88f76b req-15ef873f-b2bc-4e18-ab4c-6131b6f028fd service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:14.086790 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-067e1205-3169-4d9f-96b9-e7489f88f76b req-15ef873f-b2bc-4e18-ab4c-6131b6f028fd service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:14.099902 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-067e1205-3169-4d9f-96b9-e7489f88f76b req-15ef873f-b2bc-4e18-ab4c-6131b6f028fd service nova] Creating event network-vif-deleted:8dc5eb97-a9d3-4521-a834-083bdafe6c20 for instance 326327d5-cec9-4a20-9b94-84ef0fee670d on hv-cinder-85426 Aug 29 20:36:14.106015 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-067e1205-3169-4d9f-96b9-e7489f88f76b req-15ef873f-b2bc-4e18-ab4c-6131b6f028fd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040588 Aug 29 20:36:14.110075 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 216/446] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:36:14.171337 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e54b159c-3962-46cb-b93c-afd6f9e03446 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93dd431edc40415295518d9d24fd94af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c85b91350b74daeab5ba89364b4578e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:14.176059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6895fb4c-9aa6-484a-bbe1-f40f172877cf tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:14.176916 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6895fb4c-9aa6-484a-bbe1-f40f172877cf tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:14.182056 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e54b159c-3962-46cb-b93c-afd6f9e03446 tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 200 len: 1462 microversion: 2.1 time: 0.197971 Aug 29 20:36:14.182803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 231/447] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:13 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 1462 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:14.187699 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6895fb4c-9aa6-484a-bbe1-f40f172877cf tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:14.188302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6895fb4c-9aa6-484a-bbe1-f40f172877cf tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:14.188810 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6895fb4c-9aa6-484a-bbe1-f40f172877cf tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:14.189661 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6895fb4c-9aa6-484a-bbe1-f40f172877cf tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:14.190243 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6895fb4c-9aa6-484a-bbe1-f40f172877cf tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:14.190784 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6895fb4c-9aa6-484a-bbe1-f40f172877cf tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:14.274437 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6895fb4c-9aa6-484a-bbe1-f40f172877cf tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:14.282828 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6895fb4c-9aa6-484a-bbe1-f40f172877cf tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1211 microversion: 2.1 time: 0.111777 Aug 29 20:36:14.283602 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 217/448] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:14 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1211 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:15.208432 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4c0a542a-a2f2-4729-ad9d-23002595644b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:15.209420 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4c0a542a-a2f2-4729-ad9d-23002595644b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] [instance: 326327d5-cec9-4a20-9b94-84ef0fee670d] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:15.219185 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4c0a542a-a2f2-4729-ad9d-23002595644b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:15.220043 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4c0a542a-a2f2-4729-ad9d-23002595644b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:15.220791 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4c0a542a-a2f2-4729-ad9d-23002595644b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:15.221980 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4c0a542a-a2f2-4729-ad9d-23002595644b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:15.222772 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4c0a542a-a2f2-4729-ad9d-23002595644b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:15.223506 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4c0a542a-a2f2-4729-ad9d-23002595644b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:15.245422 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-4c0a542a-a2f2-4729-ad9d-23002595644b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] HTTP exception thrown: Instance 326327d5-cec9-4a20-9b94-84ef0fee670d could not be found. Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4c0a542a-a2f2-4729-ad9d-23002595644b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Request method failure captured: Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d HTTP/1.1 Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSL4KuUJMpfTHW_zzK6q1Vx98Ly3v-1zz0FUZ8Iw-aoWCQNSRaqZXucvbQyNklgiATNONafZxKN7R20WgkZ0-K7SR694cqaVVevpnijKF6FnRB8bNtZSrLgxOVIOWRy-HPiKqrtFvnjHqfid-STQSaunkzAYSv7t5b98Pyz6bLHPwXY Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 1c85b91350b74daeab5ba89364b4578e Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-VolumesActionsTest-76226694 Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:36:15.248312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:36:15.249901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1c85b91350b74daeab5ba89364b4578e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1c85b91350b74daeab5ba89364b4578e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1c85b91350b74daeab5ba89364b4578e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1c85b91350b74daeab5ba89364b4578e"}]}] Aug 29 20:36:15.249901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-VolumesActionsTest-76226694 Aug 29 20:36:15.249901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 1c85b91350b74daeab5ba89364b4578e Aug 29 20:36:15.249901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-VolumesActionsTest-76226694 Aug 29 20:36:15.249901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-VolumesActionsTest-76226694-project Aug 29 20:36:15.249901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:36:15.249901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:36:15.249901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 93dd431edc40415295518d9d24fd94af Aug 29 20:36:15.249901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-VolumesActionsTest-76226694-project Aug 29 20:36:15.249901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:36:15.249901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 326327d5-cec9-4a20-9b94-84ef0fee670d could not be found. Aug 29 20:36:15.249901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '326327d5-cec9-4a20-9b94-84ef0fee670d'} Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 326327d5-cec9-4a20-9b94-84ef0fee670d could not be found. Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:36:15.250645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 326327d5-cec9-4a20-9b94-84ef0fee670d could not be found. Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 326327d5-cec9-4a20-9b94-84ef0fee670d could not be found. Aug 29 20:36:15.252382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:36:15.253717 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4c0a542a-a2f2-4729-ad9d-23002595644b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] Returning 404 to user: Instance 326327d5-cec9-4a20-9b94-84ef0fee670d could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:36:15.253717 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4c0a542a-a2f2-4729-ad9d-23002595644b tempest-VolumesActionsTest-76226694 tempest-VolumesActionsTest-76226694-project] 10.222.0.18 "GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d" status: 404 len: 111 microversion: 2.1 time: 0.050062 Aug 29 20:36:15.254437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 232/449] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:15 2022] GET /compute/v2.1/servers/326327d5-cec9-4a20-9b94-84ef0fee670d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:36:15.304520 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-311b6f7f-71eb-4ad8-8561-9d5122fdf4bd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:15.305286 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-311b6f7f-71eb-4ad8-8561-9d5122fdf4bd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:15.312876 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-311b6f7f-71eb-4ad8-8561-9d5122fdf4bd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:15.313536 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-311b6f7f-71eb-4ad8-8561-9d5122fdf4bd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:15.314061 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-311b6f7f-71eb-4ad8-8561-9d5122fdf4bd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:15.314855 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-311b6f7f-71eb-4ad8-8561-9d5122fdf4bd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:15.315492 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-311b6f7f-71eb-4ad8-8561-9d5122fdf4bd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:15.316223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-311b6f7f-71eb-4ad8-8561-9d5122fdf4bd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:15.513860 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-311b6f7f-71eb-4ad8-8561-9d5122fdf4bd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:15.526719 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-311b6f7f-71eb-4ad8-8561-9d5122fdf4bd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.226131 Aug 29 20:36:15.540921 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 218/450] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:15 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:16.205847 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-483f03fd-7f46-44c2-aaf5-8c0922444c6d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:16.206340 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-483f03fd-7f46-44c2-aaf5-8c0922444c6d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:16.212378 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-483f03fd-7f46-44c2-aaf5-8c0922444c6d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:16.212996 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-483f03fd-7f46-44c2-aaf5-8c0922444c6d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:16.213277 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-483f03fd-7f46-44c2-aaf5-8c0922444c6d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:16.213991 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-483f03fd-7f46-44c2-aaf5-8c0922444c6d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:16.214442 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-483f03fd-7f46-44c2-aaf5-8c0922444c6d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:16.215047 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-483f03fd-7f46-44c2-aaf5-8c0922444c6d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:16.239103 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-483f03fd-7f46-44c2-aaf5-8c0922444c6d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/ips" status: 200 len: 150 microversion: 2.20 time: 0.037198 Aug 29 20:36:16.239702 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 233/451] 10.222.0.18 () {60 vars in 1289 bytes} [Mon Aug 29 20:36:16 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:36:16.549108 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b799fbb2-9011-4590-913c-6655aeb18166 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:16.549729 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b799fbb2-9011-4590-913c-6655aeb18166 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:16.558480 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b799fbb2-9011-4590-913c-6655aeb18166 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:16.558977 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b799fbb2-9011-4590-913c-6655aeb18166 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:16.559794 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b799fbb2-9011-4590-913c-6655aeb18166 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:16.560428 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b799fbb2-9011-4590-913c-6655aeb18166 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:16.560870 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b799fbb2-9011-4590-913c-6655aeb18166 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:16.561361 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b799fbb2-9011-4590-913c-6655aeb18166 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:16.589632 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:16.721528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-b799fbb2-9011-4590-913c-6655aeb18166 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:16.729884 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b799fbb2-9011-4590-913c-6655aeb18166 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.184695 Aug 29 20:36:16.730563 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 219/452] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:16 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:16.889008 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-fddcdb0b-2f23-4ca0-9d65-f2ad802783c5 req-c5519d62-4ff7-408b-a3bd-2b107684e37b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1773df51-c30e-4b2d-8497-eb95021c3efa", "tag": "236dc660-6b61-4948-8380-7bb59931ce55"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:16.898482 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-fddcdb0b-2f23-4ca0-9d65-f2ad802783c5 req-c5519d62-4ff7-408b-a3bd-2b107684e37b service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:16.899355 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-fddcdb0b-2f23-4ca0-9d65-f2ad802783c5 req-c5519d62-4ff7-408b-a3bd-2b107684e37b service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:16.899503 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-fddcdb0b-2f23-4ca0-9d65-f2ad802783c5 req-c5519d62-4ff7-408b-a3bd-2b107684e37b service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:16.911690 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-fddcdb0b-2f23-4ca0-9d65-f2ad802783c5 req-c5519d62-4ff7-408b-a3bd-2b107684e37b service nova] Creating event network-changed:236dc660-6b61-4948-8380-7bb59931ce55 for instance 1773df51-c30e-4b2d-8497-eb95021c3efa on hv-cinder-85426 Aug 29 20:36:16.917380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-fddcdb0b-2f23-4ca0-9d65-f2ad802783c5 req-c5519d62-4ff7-408b-a3bd-2b107684e37b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032834 Aug 29 20:36:16.917970 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 234/453] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:36:17.754952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1ff14ab0-35e5-4df5-bcf2-e0c8b058800f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:17.755761 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1ff14ab0-35e5-4df5-bcf2-e0c8b058800f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:17.767270 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ff14ab0-35e5-4df5-bcf2-e0c8b058800f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:17.767897 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ff14ab0-35e5-4df5-bcf2-e0c8b058800f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:17.768369 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ff14ab0-35e5-4df5-bcf2-e0c8b058800f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:17.769272 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ff14ab0-35e5-4df5-bcf2-e0c8b058800f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:17.769722 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ff14ab0-35e5-4df5-bcf2-e0c8b058800f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:17.770137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1ff14ab0-35e5-4df5-bcf2-e0c8b058800f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:17.956550 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1ff14ab0-35e5-4df5-bcf2-e0c8b058800f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:17.965314 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1ff14ab0-35e5-4df5-bcf2-e0c8b058800f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.215485 Aug 29 20:36:17.980185 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 220/454] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:17 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:18.246182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-523f7693-c195-4b00-97a7-59d22984cfb7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1971690839"}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:18.246801 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-523f7693-c195-4b00-97a7-59d22984cfb7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:18.254270 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-523f7693-c195-4b00-97a7-59d22984cfb7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:18.254775 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-523f7693-c195-4b00-97a7-59d22984cfb7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:18.255271 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-523f7693-c195-4b00-97a7-59d22984cfb7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:18.256186 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-523f7693-c195-4b00-97a7-59d22984cfb7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:18.256699 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-523f7693-c195-4b00-97a7-59d22984cfb7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:18.257195 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-523f7693-c195-4b00-97a7-59d22984cfb7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:18.388402 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.network.security_group_api [None req-523f7693-c195-4b00-97a7-59d22984cfb7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Adding security group 60990b08-a3f2-46d1-bb04-9b1e1406ddc6 to port d63c8d5b-2b84-4f67-944f-9f299a5aa8cb Aug 29 20:36:18.723135 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-523f7693-c195-4b00-97a7-59d22984cfb7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "POST /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/action" status: 202 len: 0 microversion: 2.1 time: 0.481243 Aug 29 20:36:18.723776 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 235/455] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 29 20:36:18 2022] POST /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:36:18.732176 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f4cf2ea0-31ca-4fdc-8d3a-bffe64d43dfc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:18.732836 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f4cf2ea0-31ca-4fdc-8d3a-bffe64d43dfc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:18.738906 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4cf2ea0-31ca-4fdc-8d3a-bffe64d43dfc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:18.739475 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4cf2ea0-31ca-4fdc-8d3a-bffe64d43dfc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:18.739998 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4cf2ea0-31ca-4fdc-8d3a-bffe64d43dfc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:18.740756 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4cf2ea0-31ca-4fdc-8d3a-bffe64d43dfc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:18.741213 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4cf2ea0-31ca-4fdc-8d3a-bffe64d43dfc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:18.741639 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f4cf2ea0-31ca-4fdc-8d3a-bffe64d43dfc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:18.884103 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f4cf2ea0-31ca-4fdc-8d3a-bffe64d43dfc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:18.892295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f4cf2ea0-31ca-4fdc-8d3a-bffe64d43dfc tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1641 microversion: 2.1 time: 0.164072 Aug 29 20:36:18.892863 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 221/456] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:18 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1641 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:18.932813 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-a6f962b2-5e6f-40b1-a29a-afa370d2e34b req-15fecfb9-cb65-43d7-be38-f276196e901e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68772d1-e335-4575-9654-313e27c49591", "tag": "d63c8d5b-2b84-4f67-944f-9f299a5aa8cb"}, {"name": "network-changed", "server_uuid": "b68772d1-e335-4575-9654-313e27c49591", "tag": "d63c8d5b-2b84-4f67-944f-9f299a5aa8cb"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:18.942592 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-a6f962b2-5e6f-40b1-a29a-afa370d2e34b req-15fecfb9-cb65-43d7-be38-f276196e901e service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:18.943061 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-a6f962b2-5e6f-40b1-a29a-afa370d2e34b req-15fecfb9-cb65-43d7-be38-f276196e901e service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:18.943491 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-a6f962b2-5e6f-40b1-a29a-afa370d2e34b req-15fecfb9-cb65-43d7-be38-f276196e901e service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:18.954316 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-a6f962b2-5e6f-40b1-a29a-afa370d2e34b req-15fecfb9-cb65-43d7-be38-f276196e901e service nova] Creating event network-changed:d63c8d5b-2b84-4f67-944f-9f299a5aa8cb for instance b68772d1-e335-4575-9654-313e27c49591 on hv-cinder-85426 Aug 29 20:36:18.954820 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-a6f962b2-5e6f-40b1-a29a-afa370d2e34b req-15fecfb9-cb65-43d7-be38-f276196e901e service nova] Creating event network-changed:d63c8d5b-2b84-4f67-944f-9f299a5aa8cb for instance b68772d1-e335-4575-9654-313e27c49591 on hv-cinder-85426 Aug 29 20:36:18.959789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-a6f962b2-5e6f-40b1-a29a-afa370d2e34b req-15fecfb9-cb65-43d7-be38-f276196e901e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.031201 Aug 29 20:36:18.960396 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 236/457] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:18.988117 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b5be66d2-a62f-4d48-94f7-00469a0616ed tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:18.988645 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b5be66d2-a62f-4d48-94f7-00469a0616ed tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:18.994578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5be66d2-a62f-4d48-94f7-00469a0616ed tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:18.995644 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5be66d2-a62f-4d48-94f7-00469a0616ed tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:18.996116 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5be66d2-a62f-4d48-94f7-00469a0616ed tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:18.996803 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5be66d2-a62f-4d48-94f7-00469a0616ed tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:18.997250 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5be66d2-a62f-4d48-94f7-00469a0616ed tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:18.997677 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b5be66d2-a62f-4d48-94f7-00469a0616ed tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:19.125701 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-b5be66d2-a62f-4d48-94f7-00469a0616ed tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:19.133506 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b5be66d2-a62f-4d48-94f7-00469a0616ed tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.149376 Aug 29 20:36:19.134059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 222/458] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:18 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:20.155066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9c5cf144-7825-4842-980a-8720809260ac tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:20.155907 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9c5cf144-7825-4842-980a-8720809260ac tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:20.168877 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c5cf144-7825-4842-980a-8720809260ac tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:20.169399 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c5cf144-7825-4842-980a-8720809260ac tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:20.169827 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c5cf144-7825-4842-980a-8720809260ac tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:20.170556 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c5cf144-7825-4842-980a-8720809260ac tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:20.170994 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c5cf144-7825-4842-980a-8720809260ac tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:20.171410 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9c5cf144-7825-4842-980a-8720809260ac tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:20.314424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9c5cf144-7825-4842-980a-8720809260ac tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:20.322069 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9c5cf144-7825-4842-980a-8720809260ac tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.172002 Aug 29 20:36:20.322625 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 237/459] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:20 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:21.343878 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b70bcd60-6811-48c6-9b25-a0300f157fa1 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:21.344771 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b70bcd60-6811-48c6-9b25-a0300f157fa1 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:21.351891 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b70bcd60-6811-48c6-9b25-a0300f157fa1 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:21.352503 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b70bcd60-6811-48c6-9b25-a0300f157fa1 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:21.353158 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b70bcd60-6811-48c6-9b25-a0300f157fa1 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:21.354053 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b70bcd60-6811-48c6-9b25-a0300f157fa1 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:21.354743 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b70bcd60-6811-48c6-9b25-a0300f157fa1 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:21.355319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b70bcd60-6811-48c6-9b25-a0300f157fa1 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:21.509525 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-b70bcd60-6811-48c6-9b25-a0300f157fa1 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:21.517996 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b70bcd60-6811-48c6-9b25-a0300f157fa1 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.177893 Aug 29 20:36:21.518619 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 223/460] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:21 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:21.534745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f26d3869-ba3c-4a40-9705-0602b92ff878 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:21.535325 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-f26d3869-ba3c-4a40-9705-0602b92ff878 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:21.543211 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f26d3869-ba3c-4a40-9705-0602b92ff878 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:21.543697 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f26d3869-ba3c-4a40-9705-0602b92ff878 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:21.544178 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f26d3869-ba3c-4a40-9705-0602b92ff878 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:21.544908 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f26d3869-ba3c-4a40-9705-0602b92ff878 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:21.545382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f26d3869-ba3c-4a40-9705-0602b92ff878 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:21.545808 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f26d3869-ba3c-4a40-9705-0602b92ff878 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:21.573212 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-f26d3869-ba3c-4a40-9705-0602b92ff878 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lazy-loading 'flavor' on Instance uuid 95026449-87b2-4f37-bfd3-554df7e6a037 {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:36:21.661435 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:21.815807 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-f26d3869-ba3c-4a40-9705-0602b92ff878 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "POST /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/action" status: 202 len: 0 microversion: 2.20 time: 0.284923 Aug 29 20:36:21.816629 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 238/461] 10.222.0.18 () {62 vars in 1319 bytes} [Mon Aug 29 20:36:21 2022] POST /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:36:21.832579 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f9c47155-ceff-4e7b-bf52-819dd2d05522 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:21.833638 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f9c47155-ceff-4e7b-bf52-819dd2d05522 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:21.845567 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:21.847596 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:21.851429 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9c47155-ceff-4e7b-bf52-819dd2d05522 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:21.852292 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9c47155-ceff-4e7b-bf52-819dd2d05522 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:21.853039 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9c47155-ceff-4e7b-bf52-819dd2d05522 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:21.854950 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9c47155-ceff-4e7b-bf52-819dd2d05522 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:21.855876 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9c47155-ceff-4e7b-bf52-819dd2d05522 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:21.856624 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f9c47155-ceff-4e7b-bf52-819dd2d05522 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:22.019202 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f9c47155-ceff-4e7b-bf52-819dd2d05522 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:22.028132 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f9c47155-ceff-4e7b-bf52-819dd2d05522 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:22.029888 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f9c47155-ceff-4e7b-bf52-819dd2d05522 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:22.031084 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f9c47155-ceff-4e7b-bf52-819dd2d05522 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.207983 Aug 29 20:36:22.031707 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 224/462] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:21 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:22.541498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ab13f241-969b-4529-a9f2-854d4c6d8f21 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:22.542884 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ab13f241-969b-4529-a9f2-854d4c6d8f21 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:22.546236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:22.552062 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ab13f241-969b-4529-a9f2-854d4c6d8f21 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:22.552884 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ab13f241-969b-4529-a9f2-854d4c6d8f21 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:22.553490 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ab13f241-969b-4529-a9f2-854d4c6d8f21 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:22.554379 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ab13f241-969b-4529-a9f2-854d4c6d8f21 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:22.554848 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ab13f241-969b-4529-a9f2-854d4c6d8f21 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:22.555271 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ab13f241-969b-4529-a9f2-854d4c6d8f21 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:22.703779 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-ab13f241-969b-4529-a9f2-854d4c6d8f21 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:22.712194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ab13f241-969b-4529-a9f2-854d4c6d8f21 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.175219 Aug 29 20:36:22.712765 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 239/463] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:22 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:23.058456 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-845a24d2-061e-4bba-b1c8-e4b1a2f8745b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:23.061347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-845a24d2-061e-4bba-b1c8-e4b1a2f8745b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:23.068729 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-845a24d2-061e-4bba-b1c8-e4b1a2f8745b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:23.069340 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-845a24d2-061e-4bba-b1c8-e4b1a2f8745b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:23.069868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-845a24d2-061e-4bba-b1c8-e4b1a2f8745b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:23.070788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-845a24d2-061e-4bba-b1c8-e4b1a2f8745b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:23.071345 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-845a24d2-061e-4bba-b1c8-e4b1a2f8745b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:23.072246 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-845a24d2-061e-4bba-b1c8-e4b1a2f8745b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:23.223421 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-845a24d2-061e-4bba-b1c8-e4b1a2f8745b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:23.232859 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-845a24d2-061e-4bba-b1c8-e4b1a2f8745b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:23.234705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-845a24d2-061e-4bba-b1c8-e4b1a2f8745b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:23.236162 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-845a24d2-061e-4bba-b1c8-e4b1a2f8745b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.185876 Aug 29 20:36:23.237306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 225/464] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:23 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:23.733860 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8dadb28a-a06b-49e8-b86a-f72c7ac55c48 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:23.734545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8dadb28a-a06b-49e8-b86a-f72c7ac55c48 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:23.741156 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8dadb28a-a06b-49e8-b86a-f72c7ac55c48 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:23.741625 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8dadb28a-a06b-49e8-b86a-f72c7ac55c48 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:23.742047 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8dadb28a-a06b-49e8-b86a-f72c7ac55c48 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:23.742736 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8dadb28a-a06b-49e8-b86a-f72c7ac55c48 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:23.743183 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8dadb28a-a06b-49e8-b86a-f72c7ac55c48 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:23.745579 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8dadb28a-a06b-49e8-b86a-f72c7ac55c48 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:23.918903 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8dadb28a-a06b-49e8-b86a-f72c7ac55c48 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:23.931089 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8dadb28a-a06b-49e8-b86a-f72c7ac55c48 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.201745 Aug 29 20:36:23.932258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 240/465] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:23 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:24.277508 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-046cd182-6b18-4727-bb8d-e9bcee88de3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:24.278217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-046cd182-6b18-4727-bb8d-e9bcee88de3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:24.291507 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:24.294990 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-046cd182-6b18-4727-bb8d-e9bcee88de3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:24.297481 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-046cd182-6b18-4727-bb8d-e9bcee88de3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:24.298661 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-046cd182-6b18-4727-bb8d-e9bcee88de3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:24.300560 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-046cd182-6b18-4727-bb8d-e9bcee88de3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:24.301949 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-046cd182-6b18-4727-bb8d-e9bcee88de3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:24.302673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-046cd182-6b18-4727-bb8d-e9bcee88de3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:24.562706 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-046cd182-6b18-4727-bb8d-e9bcee88de3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:24.575394 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-046cd182-6b18-4727-bb8d-e9bcee88de3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:24.577697 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-046cd182-6b18-4727-bb8d-e9bcee88de3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:24.579315 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-046cd182-6b18-4727-bb8d-e9bcee88de3b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.319560 Aug 29 20:36:24.580334 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 226/466] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:24 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:24.976721 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-409fc30f-2f34-4861-9741-162dc321c305 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:24.977505 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-409fc30f-2f34-4861-9741-162dc321c305 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:24.991840 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-409fc30f-2f34-4861-9741-162dc321c305 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:24.992653 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-409fc30f-2f34-4861-9741-162dc321c305 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:24.993653 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-409fc30f-2f34-4861-9741-162dc321c305 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:24.995371 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-409fc30f-2f34-4861-9741-162dc321c305 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:24.996293 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-409fc30f-2f34-4861-9741-162dc321c305 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:24.996903 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-409fc30f-2f34-4861-9741-162dc321c305 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:25.193377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-409fc30f-2f34-4861-9741-162dc321c305 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:25.203329 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-409fc30f-2f34-4861-9741-162dc321c305 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.234732 Aug 29 20:36:25.212470 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 241/467] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:24 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:25.626595 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3d44bedf-e0af-4fcf-ba20-a85051a9acea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:25.628776 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3d44bedf-e0af-4fcf-ba20-a85051a9acea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:25.645513 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d44bedf-e0af-4fcf-ba20-a85051a9acea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:25.646686 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d44bedf-e0af-4fcf-ba20-a85051a9acea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:25.647141 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d44bedf-e0af-4fcf-ba20-a85051a9acea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:25.648278 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d44bedf-e0af-4fcf-ba20-a85051a9acea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:25.649024 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d44bedf-e0af-4fcf-ba20-a85051a9acea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:25.649885 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d44bedf-e0af-4fcf-ba20-a85051a9acea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:25.857628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d44bedf-e0af-4fcf-ba20-a85051a9acea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:25.871658 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d44bedf-e0af-4fcf-ba20-a85051a9acea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:25.877332 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d44bedf-e0af-4fcf-ba20-a85051a9acea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:25.878599 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3d44bedf-e0af-4fcf-ba20-a85051a9acea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.260814 Aug 29 20:36:25.879101 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 227/468] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:25 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:26.223283 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-427064e7-c6b6-441f-ab1c-744ccbf2e2d5 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:26.224719 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-427064e7-c6b6-441f-ab1c-744ccbf2e2d5 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:26.232129 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-427064e7-c6b6-441f-ab1c-744ccbf2e2d5 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:26.232920 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-427064e7-c6b6-441f-ab1c-744ccbf2e2d5 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:26.233551 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-427064e7-c6b6-441f-ab1c-744ccbf2e2d5 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:26.234635 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-427064e7-c6b6-441f-ab1c-744ccbf2e2d5 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:26.235297 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-427064e7-c6b6-441f-ab1c-744ccbf2e2d5 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:26.235979 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-427064e7-c6b6-441f-ab1c-744ccbf2e2d5 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:26.429044 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-427064e7-c6b6-441f-ab1c-744ccbf2e2d5 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:26.442602 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-427064e7-c6b6-441f-ab1c-744ccbf2e2d5 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.221876 Aug 29 20:36:26.446482 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 242/469] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:26 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:26.908291 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ae7cf42-8f08-4e48-8db3-3a7bd74e162f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:26.910165 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3ae7cf42-8f08-4e48-8db3-3a7bd74e162f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:26.920851 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ae7cf42-8f08-4e48-8db3-3a7bd74e162f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:26.922172 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ae7cf42-8f08-4e48-8db3-3a7bd74e162f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:26.922891 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ae7cf42-8f08-4e48-8db3-3a7bd74e162f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:26.923766 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ae7cf42-8f08-4e48-8db3-3a7bd74e162f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:26.925409 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ae7cf42-8f08-4e48-8db3-3a7bd74e162f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:26.925409 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ae7cf42-8f08-4e48-8db3-3a7bd74e162f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:27.132648 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ae7cf42-8f08-4e48-8db3-3a7bd74e162f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:27.147484 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ae7cf42-8f08-4e48-8db3-3a7bd74e162f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:27.150109 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3ae7cf42-8f08-4e48-8db3-3a7bd74e162f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:27.152252 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3ae7cf42-8f08-4e48-8db3-3a7bd74e162f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.249097 Aug 29 20:36:27.153509 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 228/470] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:26 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:27.475824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ad000fad-d26a-4cdd-bcea-ab1b75661a19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:27.477298 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ad000fad-d26a-4cdd-bcea-ab1b75661a19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:27.489553 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ad000fad-d26a-4cdd-bcea-ab1b75661a19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:27.490932 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ad000fad-d26a-4cdd-bcea-ab1b75661a19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:27.491964 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ad000fad-d26a-4cdd-bcea-ab1b75661a19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:27.493436 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ad000fad-d26a-4cdd-bcea-ab1b75661a19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:27.495128 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ad000fad-d26a-4cdd-bcea-ab1b75661a19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:27.496149 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ad000fad-d26a-4cdd-bcea-ab1b75661a19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:27.715461 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-ad000fad-d26a-4cdd-bcea-ab1b75661a19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:27.724542 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ad000fad-d26a-4cdd-bcea-ab1b75661a19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.261601 Aug 29 20:36:27.725156 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 243/471] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:27 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:28.189556 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-24d41d37-abdb-489a-bf25-720c08c6bc3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:28.191469 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-24d41d37-abdb-489a-bf25-720c08c6bc3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:28.203926 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d41d37-abdb-489a-bf25-720c08c6bc3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:28.204938 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d41d37-abdb-489a-bf25-720c08c6bc3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:28.205711 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d41d37-abdb-489a-bf25-720c08c6bc3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:28.207024 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d41d37-abdb-489a-bf25-720c08c6bc3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:28.207622 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d41d37-abdb-489a-bf25-720c08c6bc3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:28.208687 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-24d41d37-abdb-489a-bf25-720c08c6bc3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:28.427858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-24d41d37-abdb-489a-bf25-720c08c6bc3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:28.447493 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-24d41d37-abdb-489a-bf25-720c08c6bc3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:28.449100 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-24d41d37-abdb-489a-bf25-720c08c6bc3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:28.451482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-24d41d37-abdb-489a-bf25-720c08c6bc3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.269058 Aug 29 20:36:28.457164 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 229/472] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:28 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:36:28.748522 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b04359a8-50cb-498b-bb0d-78533310c189 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:28.749842 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b04359a8-50cb-498b-bb0d-78533310c189 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:28.758376 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b04359a8-50cb-498b-bb0d-78533310c189 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:28.759521 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b04359a8-50cb-498b-bb0d-78533310c189 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:28.759793 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b04359a8-50cb-498b-bb0d-78533310c189 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:28.761275 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b04359a8-50cb-498b-bb0d-78533310c189 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:28.761812 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b04359a8-50cb-498b-bb0d-78533310c189 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:28.762288 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b04359a8-50cb-498b-bb0d-78533310c189 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:28.913648 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b04359a8-50cb-498b-bb0d-78533310c189 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:28.923636 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b04359a8-50cb-498b-bb0d-78533310c189 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.178835 Aug 29 20:36:28.936771 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 244/473] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:28 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:29.475561 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2febdc5c-bb1e-4f5f-9f31-45a09ffcf126 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:29.476302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2febdc5c-bb1e-4f5f-9f31-45a09ffcf126 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:29.483672 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2febdc5c-bb1e-4f5f-9f31-45a09ffcf126 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:29.484209 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2febdc5c-bb1e-4f5f-9f31-45a09ffcf126 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:29.484841 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2febdc5c-bb1e-4f5f-9f31-45a09ffcf126 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:29.485553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2febdc5c-bb1e-4f5f-9f31-45a09ffcf126 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:29.486002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2febdc5c-bb1e-4f5f-9f31-45a09ffcf126 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:29.486429 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2febdc5c-bb1e-4f5f-9f31-45a09ffcf126 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:29.650576 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-2febdc5c-bb1e-4f5f-9f31-45a09ffcf126 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:29.662132 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-2febdc5c-bb1e-4f5f-9f31-45a09ffcf126 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:29.663696 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-2febdc5c-bb1e-4f5f-9f31-45a09ffcf126 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:29.665154 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2febdc5c-bb1e-4f5f-9f31-45a09ffcf126 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.193873 Aug 29 20:36:29.665749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 230/474] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:29 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:29.946689 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-cb6ebf8d-2391-46b7-a41c-5044a2a237e3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:29.948057 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-cb6ebf8d-2391-46b7-a41c-5044a2a237e3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:29.954864 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cb6ebf8d-2391-46b7-a41c-5044a2a237e3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:29.955675 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cb6ebf8d-2391-46b7-a41c-5044a2a237e3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:29.956360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cb6ebf8d-2391-46b7-a41c-5044a2a237e3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:29.957294 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cb6ebf8d-2391-46b7-a41c-5044a2a237e3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:29.957851 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cb6ebf8d-2391-46b7-a41c-5044a2a237e3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:29.958373 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cb6ebf8d-2391-46b7-a41c-5044a2a237e3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:30.130851 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-cb6ebf8d-2391-46b7-a41c-5044a2a237e3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:30.140324 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-cb6ebf8d-2391-46b7-a41c-5044a2a237e3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.197461 Aug 29 20:36:30.140912 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 245/475] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:29 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:30.692796 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6970e54d-15d7-4286-a6fc-ed440559ed16 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:30.693964 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6970e54d-15d7-4286-a6fc-ed440559ed16 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:30.709900 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6970e54d-15d7-4286-a6fc-ed440559ed16 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:30.710728 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6970e54d-15d7-4286-a6fc-ed440559ed16 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:30.711541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6970e54d-15d7-4286-a6fc-ed440559ed16 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:30.712519 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6970e54d-15d7-4286-a6fc-ed440559ed16 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:30.713163 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6970e54d-15d7-4286-a6fc-ed440559ed16 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:30.714439 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6970e54d-15d7-4286-a6fc-ed440559ed16 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:30.830113 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-452058ce-fb21-4279-9138-590b7c453b8e req-733b16b8-c9cd-41db-809c-43614eaaf787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1773df51-c30e-4b2d-8497-eb95021c3efa", "name": "network-vif-plugged", "status": "completed", "tag": "236dc660-6b61-4948-8380-7bb59931ce55"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:30.849238 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-452058ce-fb21-4279-9138-590b7c453b8e req-733b16b8-c9cd-41db-809c-43614eaaf787 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:30.849826 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-452058ce-fb21-4279-9138-590b7c453b8e req-733b16b8-c9cd-41db-809c-43614eaaf787 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:30.850318 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-452058ce-fb21-4279-9138-590b7c453b8e req-733b16b8-c9cd-41db-809c-43614eaaf787 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:30.875597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-452058ce-fb21-4279-9138-590b7c453b8e req-733b16b8-c9cd-41db-809c-43614eaaf787 service nova] Creating event network-vif-plugged:236dc660-6b61-4948-8380-7bb59931ce55 for instance 1773df51-c30e-4b2d-8497-eb95021c3efa on hv-cinder-85426 Aug 29 20:36:30.893257 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-452058ce-fb21-4279-9138-590b7c453b8e req-733b16b8-c9cd-41db-809c-43614eaaf787 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066508 Aug 29 20:36:30.894791 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 246/476] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:30.973260 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6970e54d-15d7-4286-a6fc-ed440559ed16 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:30.990190 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6970e54d-15d7-4286-a6fc-ed440559ed16 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:30.991647 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6970e54d-15d7-4286-a6fc-ed440559ed16 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:30.992884 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6970e54d-15d7-4286-a6fc-ed440559ed16 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.304861 Aug 29 20:36:30.993685 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 231/477] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:30 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:31.165658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-54644ba3-56ff-49d7-9165-e416dd74d8c0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:31.167532 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-54644ba3-56ff-49d7-9165-e416dd74d8c0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:31.183190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54644ba3-56ff-49d7-9165-e416dd74d8c0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:31.184274 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54644ba3-56ff-49d7-9165-e416dd74d8c0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:31.185198 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54644ba3-56ff-49d7-9165-e416dd74d8c0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:31.186660 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54644ba3-56ff-49d7-9165-e416dd74d8c0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:31.187535 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54644ba3-56ff-49d7-9165-e416dd74d8c0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:31.188021 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54644ba3-56ff-49d7-9165-e416dd74d8c0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:31.362656 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-54644ba3-56ff-49d7-9165-e416dd74d8c0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:31.373470 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-54644ba3-56ff-49d7-9165-e416dd74d8c0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.211762 Aug 29 20:36:31.374252 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 247/478] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:31 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:32.017300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e9280565-ead5-4d73-9243-130c796203f4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:32.017874 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e9280565-ead5-4d73-9243-130c796203f4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:32.025542 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9280565-ead5-4d73-9243-130c796203f4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:32.026854 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9280565-ead5-4d73-9243-130c796203f4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:32.027616 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9280565-ead5-4d73-9243-130c796203f4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:32.028631 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9280565-ead5-4d73-9243-130c796203f4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:32.029574 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9280565-ead5-4d73-9243-130c796203f4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:32.030275 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e9280565-ead5-4d73-9243-130c796203f4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:32.227639 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e9280565-ead5-4d73-9243-130c796203f4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:32.239126 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e9280565-ead5-4d73-9243-130c796203f4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:32.240658 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e9280565-ead5-4d73-9243-130c796203f4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:32.241834 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e9280565-ead5-4d73-9243-130c796203f4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.229023 Aug 29 20:36:32.242414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 232/479] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:32 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:32.397645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-59c6046f-720b-458e-a11e-993341ff2c38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:32.399901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-59c6046f-720b-458e-a11e-993341ff2c38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:32.412356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59c6046f-720b-458e-a11e-993341ff2c38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:32.413608 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59c6046f-720b-458e-a11e-993341ff2c38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:32.414394 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59c6046f-720b-458e-a11e-993341ff2c38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:32.415684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59c6046f-720b-458e-a11e-993341ff2c38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:32.416549 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59c6046f-720b-458e-a11e-993341ff2c38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:32.417347 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59c6046f-720b-458e-a11e-993341ff2c38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:32.592722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-59c6046f-720b-458e-a11e-993341ff2c38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:32.601543 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-59c6046f-720b-458e-a11e-993341ff2c38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1266 microversion: 2.1 time: 0.210420 Aug 29 20:36:32.602390 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 248/480] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:32 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:33.266193 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e8d349c5-3a82-4b0b-97ad-23ce767ca86a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:33.267476 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e8d349c5-3a82-4b0b-97ad-23ce767ca86a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:33.277284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8d349c5-3a82-4b0b-97ad-23ce767ca86a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:33.278312 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8d349c5-3a82-4b0b-97ad-23ce767ca86a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:33.278910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8d349c5-3a82-4b0b-97ad-23ce767ca86a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:33.279869 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8d349c5-3a82-4b0b-97ad-23ce767ca86a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:33.280559 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8d349c5-3a82-4b0b-97ad-23ce767ca86a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:33.281103 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8d349c5-3a82-4b0b-97ad-23ce767ca86a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:33.449165 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8d349c5-3a82-4b0b-97ad-23ce767ca86a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:33.459467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8d349c5-3a82-4b0b-97ad-23ce767ca86a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:33.460952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8d349c5-3a82-4b0b-97ad-23ce767ca86a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:33.462350 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e8d349c5-3a82-4b0b-97ad-23ce767ca86a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.200291 Aug 29 20:36:33.463080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 233/481] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:33 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:33.624222 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2f71c4e9-3673-49e7-ac29-191cac7555cc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:33.626799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2f71c4e9-3673-49e7-ac29-191cac7555cc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:33.630841 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=62 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:33.636235 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f71c4e9-3673-49e7-ac29-191cac7555cc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:33.636931 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f71c4e9-3673-49e7-ac29-191cac7555cc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:33.637532 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f71c4e9-3673-49e7-ac29-191cac7555cc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:33.638394 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f71c4e9-3673-49e7-ac29-191cac7555cc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:33.638854 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f71c4e9-3673-49e7-ac29-191cac7555cc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:33.639428 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f71c4e9-3673-49e7-ac29-191cac7555cc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:33.862695 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2f71c4e9-3673-49e7-ac29-191cac7555cc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:33.871831 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2f71c4e9-3673-49e7-ac29-191cac7555cc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1451 microversion: 2.1 time: 0.252310 Aug 29 20:36:33.872585 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 249/482] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:33 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1451 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:33.903053 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-18fe22c5-3ec6-4ad1-b2a0-f4766f86558b tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:33.903627 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-18fe22c5-3ec6-4ad1-b2a0-f4766f86558b tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:33.910280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18fe22c5-3ec6-4ad1-b2a0-f4766f86558b tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:33.910773 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18fe22c5-3ec6-4ad1-b2a0-f4766f86558b tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:33.911271 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18fe22c5-3ec6-4ad1-b2a0-f4766f86558b tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:33.912130 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18fe22c5-3ec6-4ad1-b2a0-f4766f86558b tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:33.912557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18fe22c5-3ec6-4ad1-b2a0-f4766f86558b tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:33.912979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-18fe22c5-3ec6-4ad1-b2a0-f4766f86558b tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:34.080060 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-18fe22c5-3ec6-4ad1-b2a0-f4766f86558b tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:34.092239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-18fe22c5-3ec6-4ad1-b2a0-f4766f86558b tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1451 microversion: 2.1 time: 0.193099 Aug 29 20:36:34.093077 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 234/483] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:33 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1451 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:34.487800 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-0203c812-b9ac-4228-9ecd-3409160cdd4d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:34.491367 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-0203c812-b9ac-4228-9ecd-3409160cdd4d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:34.502334 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0203c812-b9ac-4228-9ecd-3409160cdd4d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:34.503227 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0203c812-b9ac-4228-9ecd-3409160cdd4d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:34.504040 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0203c812-b9ac-4228-9ecd-3409160cdd4d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:34.505918 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0203c812-b9ac-4228-9ecd-3409160cdd4d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:34.506910 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0203c812-b9ac-4228-9ecd-3409160cdd4d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:34.507654 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0203c812-b9ac-4228-9ecd-3409160cdd4d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:34.672383 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-0203c812-b9ac-4228-9ecd-3409160cdd4d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:34.687260 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-0203c812-b9ac-4228-9ecd-3409160cdd4d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:34.689952 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-0203c812-b9ac-4228-9ecd-3409160cdd4d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:34.691370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-0203c812-b9ac-4228-9ecd-3409160cdd4d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.208850 Aug 29 20:36:34.706572 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 250/484] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:34 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:35.721570 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85d8c8b6-8c2c-45c0-9540-7b9a3dd5e354 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:35.722981 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85d8c8b6-8c2c-45c0-9540-7b9a3dd5e354 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:35.753731 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85d8c8b6-8c2c-45c0-9540-7b9a3dd5e354 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:35.755964 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85d8c8b6-8c2c-45c0-9540-7b9a3dd5e354 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:35.757829 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85d8c8b6-8c2c-45c0-9540-7b9a3dd5e354 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:35.758710 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85d8c8b6-8c2c-45c0-9540-7b9a3dd5e354 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:35.761143 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85d8c8b6-8c2c-45c0-9540-7b9a3dd5e354 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:35.766555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85d8c8b6-8c2c-45c0-9540-7b9a3dd5e354 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:36.045082 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-85d8c8b6-8c2c-45c0-9540-7b9a3dd5e354 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:36.053037 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:36.064808 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-85d8c8b6-8c2c-45c0-9540-7b9a3dd5e354 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:36.067047 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-85d8c8b6-8c2c-45c0-9540-7b9a3dd5e354 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:36.068603 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85d8c8b6-8c2c-45c0-9540-7b9a3dd5e354 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.358110 Aug 29 20:36:36.069699 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 235/485] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:35 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:36.456251 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-16073662-ad65-4033-9b21-84eb35397e6d req-14864478-6911-4189-a091-adcf39f6366e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1773df51-c30e-4b2d-8497-eb95021c3efa", "tag": "236dc660-6b61-4948-8380-7bb59931ce55"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:36.475169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-16073662-ad65-4033-9b21-84eb35397e6d req-14864478-6911-4189-a091-adcf39f6366e service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:36.475980 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-16073662-ad65-4033-9b21-84eb35397e6d req-14864478-6911-4189-a091-adcf39f6366e service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:36.476716 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-16073662-ad65-4033-9b21-84eb35397e6d req-14864478-6911-4189-a091-adcf39f6366e service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:36.501304 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-16073662-ad65-4033-9b21-84eb35397e6d req-14864478-6911-4189-a091-adcf39f6366e service nova] Creating event network-changed:236dc660-6b61-4948-8380-7bb59931ce55 for instance 1773df51-c30e-4b2d-8497-eb95021c3efa on hv-cinder-85426 Aug 29 20:36:36.509812 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-16073662-ad65-4033-9b21-84eb35397e6d req-14864478-6911-4189-a091-adcf39f6366e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058371 Aug 29 20:36:36.511604 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 251/486] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:37.096062 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f5306a94-3952-46f6-bc0e-d5415950be09 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:37.097902 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f5306a94-3952-46f6-bc0e-d5415950be09 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:37.108660 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5306a94-3952-46f6-bc0e-d5415950be09 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:37.109915 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5306a94-3952-46f6-bc0e-d5415950be09 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:37.110931 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5306a94-3952-46f6-bc0e-d5415950be09 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:37.112424 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5306a94-3952-46f6-bc0e-d5415950be09 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:37.113494 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5306a94-3952-46f6-bc0e-d5415950be09 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:37.114481 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5306a94-3952-46f6-bc0e-d5415950be09 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:37.397010 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f5306a94-3952-46f6-bc0e-d5415950be09 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:37.408117 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f5306a94-3952-46f6-bc0e-d5415950be09 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:37.410231 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f5306a94-3952-46f6-bc0e-d5415950be09 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:37.411573 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f5306a94-3952-46f6-bc0e-d5415950be09 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.322129 Aug 29 20:36:37.424294 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 236/487] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:37 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:38.435743 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-efe1ae71-87f9-4b22-88b5-9bfd7b3cb754 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:38.436500 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-efe1ae71-87f9-4b22-88b5-9bfd7b3cb754 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:38.451566 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-efe1ae71-87f9-4b22-88b5-9bfd7b3cb754 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:38.452183 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-efe1ae71-87f9-4b22-88b5-9bfd7b3cb754 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:38.452625 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-efe1ae71-87f9-4b22-88b5-9bfd7b3cb754 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:38.453323 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-efe1ae71-87f9-4b22-88b5-9bfd7b3cb754 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:38.453784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-efe1ae71-87f9-4b22-88b5-9bfd7b3cb754 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:38.454330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-efe1ae71-87f9-4b22-88b5-9bfd7b3cb754 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:38.615717 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-efe1ae71-87f9-4b22-88b5-9bfd7b3cb754 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:38.624070 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-efe1ae71-87f9-4b22-88b5-9bfd7b3cb754 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:38.625606 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-efe1ae71-87f9-4b22-88b5-9bfd7b3cb754 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:38.626761 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-efe1ae71-87f9-4b22-88b5-9bfd7b3cb754 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.195547 Aug 29 20:36:38.627311 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 252/488] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:38 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:39.649430 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1698eb5f-39fa-4b57-aa5d-488c2475709f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:39.650044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1698eb5f-39fa-4b57-aa5d-488c2475709f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:39.657021 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1698eb5f-39fa-4b57-aa5d-488c2475709f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:39.657509 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1698eb5f-39fa-4b57-aa5d-488c2475709f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:39.657938 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1698eb5f-39fa-4b57-aa5d-488c2475709f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:39.658645 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1698eb5f-39fa-4b57-aa5d-488c2475709f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:39.659095 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1698eb5f-39fa-4b57-aa5d-488c2475709f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:39.659515 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1698eb5f-39fa-4b57-aa5d-488c2475709f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:39.826601 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1698eb5f-39fa-4b57-aa5d-488c2475709f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:39.840062 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1698eb5f-39fa-4b57-aa5d-488c2475709f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:39.842490 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1698eb5f-39fa-4b57-aa5d-488c2475709f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:39.844324 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1698eb5f-39fa-4b57-aa5d-488c2475709f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.198691 Aug 29 20:36:39.845154 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 237/489] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:39 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:40.872738 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d36ceee3-4f73-4b97-ac39-b639b4938d7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:40.873357 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d36ceee3-4f73-4b97-ac39-b639b4938d7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:40.881261 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d36ceee3-4f73-4b97-ac39-b639b4938d7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:40.881886 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d36ceee3-4f73-4b97-ac39-b639b4938d7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:40.882523 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d36ceee3-4f73-4b97-ac39-b639b4938d7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:40.883480 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d36ceee3-4f73-4b97-ac39-b639b4938d7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:40.884086 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d36ceee3-4f73-4b97-ac39-b639b4938d7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:40.884660 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d36ceee3-4f73-4b97-ac39-b639b4938d7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:41.037825 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d36ceee3-4f73-4b97-ac39-b639b4938d7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:41.047403 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d36ceee3-4f73-4b97-ac39-b639b4938d7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:41.048898 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d36ceee3-4f73-4b97-ac39-b639b4938d7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:41.050070 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d36ceee3-4f73-4b97-ac39-b639b4938d7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.181958 Aug 29 20:36:41.050668 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 253/490] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:40 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:41.236372 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c8eefc1b-f6bc-459c-aff4-51981343c59d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:41.237064 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c8eefc1b-f6bc-459c-aff4-51981343c59d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:41.243868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8eefc1b-f6bc-459c-aff4-51981343c59d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:41.244387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8eefc1b-f6bc-459c-aff4-51981343c59d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:41.244816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8eefc1b-f6bc-459c-aff4-51981343c59d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:41.245524 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8eefc1b-f6bc-459c-aff4-51981343c59d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:41.245975 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8eefc1b-f6bc-459c-aff4-51981343c59d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:41.246395 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c8eefc1b-f6bc-459c-aff4-51981343c59d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:41.399445 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-c8eefc1b-f6bc-459c-aff4-51981343c59d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lazy-loading 'services' on Instance uuid dfdda123-bbf1-425b-b690-2d0919df08a2 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:36:41.518000 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c8eefc1b-f6bc-459c-aff4-51981343c59d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/os-volume_attachments/b3af6f23-1c86-4f18-871f-a5cf7b2ca270" status: 202 len: 0 microversion: 2.1 time: 0.285698 Aug 29 20:36:41.518571 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 238/491] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 29 20:36:41 2022] DELETE /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/os-volume_attachments/b3af6f23-1c86-4f18-871f-a5cf7b2ca270 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:36:42.073915 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-05ded9d0-ff06-49f9-b861-33efb90b39f9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:42.074788 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-05ded9d0-ff06-49f9-b861-33efb90b39f9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:42.081509 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-05ded9d0-ff06-49f9-b861-33efb90b39f9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:42.081999 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-05ded9d0-ff06-49f9-b861-33efb90b39f9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:42.082434 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-05ded9d0-ff06-49f9-b861-33efb90b39f9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:42.083138 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-05ded9d0-ff06-49f9-b861-33efb90b39f9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:42.083591 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-05ded9d0-ff06-49f9-b861-33efb90b39f9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:42.084110 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-05ded9d0-ff06-49f9-b861-33efb90b39f9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:42.249833 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-05ded9d0-ff06-49f9-b861-33efb90b39f9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:42.262418 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-05ded9d0-ff06-49f9-b861-33efb90b39f9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:42.265267 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-05ded9d0-ff06-49f9-b861-33efb90b39f9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:42.267504 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-05ded9d0-ff06-49f9-b861-33efb90b39f9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.197911 Aug 29 20:36:42.268545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 254/492] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:42 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:42.661671 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-adab7f48-6eeb-4c51-9470-e8788e32bb76 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:42.668831 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adab7f48-6eeb-4c51-9470-e8788e32bb76 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:42.669322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adab7f48-6eeb-4c51-9470-e8788e32bb76 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:42.669763 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-adab7f48-6eeb-4c51-9470-e8788e32bb76 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:42.694806 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-adab7f48-6eeb-4c51-9470-e8788e32bb76 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Going to try to stop instance {{(pid=127028) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 20:36:42.754046 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-adab7f48-6eeb-4c51-9470-e8788e32bb76 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "POST /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/action" status: 202 len: 0 microversion: 2.1 time: 0.097017 Aug 29 20:36:42.755014 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 239/493] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 29 20:36:42 2022] POST /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:36:42.770120 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6f5d8846-879c-4c2c-b632-b22dd630127f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:42.771138 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6f5d8846-879c-4c2c-b632-b22dd630127f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:42.779801 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6f5d8846-879c-4c2c-b632-b22dd630127f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:42.780311 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6f5d8846-879c-4c2c-b632-b22dd630127f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:42.780743 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6f5d8846-879c-4c2c-b632-b22dd630127f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:42.781449 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6f5d8846-879c-4c2c-b632-b22dd630127f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:42.781891 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6f5d8846-879c-4c2c-b632-b22dd630127f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:42.782306 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6f5d8846-879c-4c2c-b632-b22dd630127f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:42.957358 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-6f5d8846-879c-4c2c-b632-b22dd630127f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:42.970894 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6f5d8846-879c-4c2c-b632-b22dd630127f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1677 microversion: 2.1 time: 0.206798 Aug 29 20:36:42.971883 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 255/494] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:42 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1677 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:43.294517 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bfea5e4e-a0a0-4dde-bb4f-970008c21d8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:43.295452 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bfea5e4e-a0a0-4dde-bb4f-970008c21d8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:43.301833 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfea5e4e-a0a0-4dde-bb4f-970008c21d8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:43.302314 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfea5e4e-a0a0-4dde-bb4f-970008c21d8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:43.302747 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfea5e4e-a0a0-4dde-bb4f-970008c21d8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:43.303446 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfea5e4e-a0a0-4dde-bb4f-970008c21d8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:43.304024 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfea5e4e-a0a0-4dde-bb4f-970008c21d8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:43.304451 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bfea5e4e-a0a0-4dde-bb4f-970008c21d8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:43.438584 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bfea5e4e-a0a0-4dde-bb4f-970008c21d8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:43.449756 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bfea5e4e-a0a0-4dde-bb4f-970008c21d8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:43.449756 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bfea5e4e-a0a0-4dde-bb4f-970008c21d8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:43.450339 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bfea5e4e-a0a0-4dde-bb4f-970008c21d8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1742 microversion: 2.20 time: 0.161903 Aug 29 20:36:43.450890 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 240/495] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:43 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:43.997531 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-77089bf7-4d41-4926-9c08-4c2cfe2a7cf0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:43.998154 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-77089bf7-4d41-4926-9c08-4c2cfe2a7cf0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:44.004763 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-77089bf7-4d41-4926-9c08-4c2cfe2a7cf0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:44.005244 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-77089bf7-4d41-4926-9c08-4c2cfe2a7cf0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:44.005672 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-77089bf7-4d41-4926-9c08-4c2cfe2a7cf0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:44.006392 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-77089bf7-4d41-4926-9c08-4c2cfe2a7cf0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:44.006843 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-77089bf7-4d41-4926-9c08-4c2cfe2a7cf0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:44.007260 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-77089bf7-4d41-4926-9c08-4c2cfe2a7cf0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:44.011547 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:44.164177 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-77089bf7-4d41-4926-9c08-4c2cfe2a7cf0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:44.173486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-77089bf7-4d41-4926-9c08-4c2cfe2a7cf0 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1677 microversion: 2.1 time: 0.179882 Aug 29 20:36:44.174332 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 256/496] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:43 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:44.473680 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bc34f96e-a03c-4ebf-8274-82151a913441 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:44.474343 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bc34f96e-a03c-4ebf-8274-82151a913441 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:44.480988 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc34f96e-a03c-4ebf-8274-82151a913441 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:44.481468 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc34f96e-a03c-4ebf-8274-82151a913441 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:44.481902 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc34f96e-a03c-4ebf-8274-82151a913441 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:44.483148 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc34f96e-a03c-4ebf-8274-82151a913441 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:44.483148 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc34f96e-a03c-4ebf-8274-82151a913441 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:44.483424 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bc34f96e-a03c-4ebf-8274-82151a913441 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:44.647063 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bc34f96e-a03c-4ebf-8274-82151a913441 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:44.656582 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bc34f96e-a03c-4ebf-8274-82151a913441 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:44.658045 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bc34f96e-a03c-4ebf-8274-82151a913441 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:44.659184 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bc34f96e-a03c-4ebf-8274-82151a913441 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1742 microversion: 2.20 time: 0.189741 Aug 29 20:36:44.659971 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 241/497] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:44 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1742 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:45.206394 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-80fa0983-1284-451f-a5eb-e4d8825106a3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:45.207250 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-80fa0983-1284-451f-a5eb-e4d8825106a3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:45.217818 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80fa0983-1284-451f-a5eb-e4d8825106a3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:45.218552 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80fa0983-1284-451f-a5eb-e4d8825106a3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:45.219210 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80fa0983-1284-451f-a5eb-e4d8825106a3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:45.220338 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80fa0983-1284-451f-a5eb-e4d8825106a3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:45.221040 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80fa0983-1284-451f-a5eb-e4d8825106a3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:45.221694 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-80fa0983-1284-451f-a5eb-e4d8825106a3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:45.417293 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-80fa0983-1284-451f-a5eb-e4d8825106a3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:45.429157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-80fa0983-1284-451f-a5eb-e4d8825106a3 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1677 microversion: 2.1 time: 0.228744 Aug 29 20:36:45.430001 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 257/498] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:45 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:45.694763 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0e98f431-c9ab-4cc1-8b9b-78f68f229714 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:45.695863 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0e98f431-c9ab-4cc1-8b9b-78f68f229714 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:45.704262 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e98f431-c9ab-4cc1-8b9b-78f68f229714 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:45.704897 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e98f431-c9ab-4cc1-8b9b-78f68f229714 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:45.705328 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e98f431-c9ab-4cc1-8b9b-78f68f229714 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:45.706035 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e98f431-c9ab-4cc1-8b9b-78f68f229714 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:45.706483 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e98f431-c9ab-4cc1-8b9b-78f68f229714 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:45.706904 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0e98f431-c9ab-4cc1-8b9b-78f68f229714 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:45.863591 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0e98f431-c9ab-4cc1-8b9b-78f68f229714 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:45.872372 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0e98f431-c9ab-4cc1-8b9b-78f68f229714 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:45.873817 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0e98f431-c9ab-4cc1-8b9b-78f68f229714 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:45.874983 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0e98f431-c9ab-4cc1-8b9b-78f68f229714 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1742 microversion: 2.20 time: 0.193954 Aug 29 20:36:45.875557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 242/499] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:45 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1742 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:46.463883 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2d74f4ec-4620-44a9-a6ad-e76facc30e12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:46.464399 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2d74f4ec-4620-44a9-a6ad-e76facc30e12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:46.471333 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d74f4ec-4620-44a9-a6ad-e76facc30e12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:46.471916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d74f4ec-4620-44a9-a6ad-e76facc30e12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:46.472452 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d74f4ec-4620-44a9-a6ad-e76facc30e12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:46.473169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d74f4ec-4620-44a9-a6ad-e76facc30e12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:46.473627 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d74f4ec-4620-44a9-a6ad-e76facc30e12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:46.474052 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d74f4ec-4620-44a9-a6ad-e76facc30e12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:46.667788 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2d74f4ec-4620-44a9-a6ad-e76facc30e12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:46.683261 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2d74f4ec-4620-44a9-a6ad-e76facc30e12 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1677 microversion: 2.1 time: 0.224585 Aug 29 20:36:46.684705 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 258/500] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:46 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1677 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:46.901203 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-38fc1dad-0bb6-4453-be44-956f1cc196d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:46.902094 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-38fc1dad-0bb6-4453-be44-956f1cc196d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:46.910735 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38fc1dad-0bb6-4453-be44-956f1cc196d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:46.912126 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38fc1dad-0bb6-4453-be44-956f1cc196d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:46.912808 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38fc1dad-0bb6-4453-be44-956f1cc196d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:46.913888 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38fc1dad-0bb6-4453-be44-956f1cc196d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:46.914552 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38fc1dad-0bb6-4453-be44-956f1cc196d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:46.915333 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38fc1dad-0bb6-4453-be44-956f1cc196d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:47.091466 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-38fc1dad-0bb6-4453-be44-956f1cc196d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:47.102697 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-38fc1dad-0bb6-4453-be44-956f1cc196d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:47.104285 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-38fc1dad-0bb6-4453-be44-956f1cc196d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:47.105625 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-38fc1dad-0bb6-4453-be44-956f1cc196d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1737 microversion: 2.20 time: 0.209264 Aug 29 20:36:47.121978 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 243/501] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:46 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:47.706211 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-82410acd-36ab-470e-8c82-62d0ec523919 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:47.706894 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-82410acd-36ab-470e-8c82-62d0ec523919 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:47.714299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-82410acd-36ab-470e-8c82-62d0ec523919 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:47.714793 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-82410acd-36ab-470e-8c82-62d0ec523919 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:47.715231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-82410acd-36ab-470e-8c82-62d0ec523919 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:47.715956 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-82410acd-36ab-470e-8c82-62d0ec523919 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:47.716646 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-82410acd-36ab-470e-8c82-62d0ec523919 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:47.717279 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-82410acd-36ab-470e-8c82-62d0ec523919 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:47.884900 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-82410acd-36ab-470e-8c82-62d0ec523919 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:47.893325 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-82410acd-36ab-470e-8c82-62d0ec523919 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1677 microversion: 2.1 time: 0.191226 Aug 29 20:36:47.893941 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 259/502] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:47 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:48.132769 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-895ef239-20e9-40b4-b47f-98989b588d8d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:48.133536 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-895ef239-20e9-40b4-b47f-98989b588d8d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:48.140871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-895ef239-20e9-40b4-b47f-98989b588d8d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:48.141681 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-895ef239-20e9-40b4-b47f-98989b588d8d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:48.142726 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-895ef239-20e9-40b4-b47f-98989b588d8d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:48.143587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-895ef239-20e9-40b4-b47f-98989b588d8d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:48.144797 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-895ef239-20e9-40b4-b47f-98989b588d8d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:48.145335 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-895ef239-20e9-40b4-b47f-98989b588d8d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:48.311139 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-895ef239-20e9-40b4-b47f-98989b588d8d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:48.321356 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-895ef239-20e9-40b4-b47f-98989b588d8d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:48.326491 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-895ef239-20e9-40b4-b47f-98989b588d8d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:48.328353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-895ef239-20e9-40b4-b47f-98989b588d8d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1737 microversion: 2.20 time: 0.202175 Aug 29 20:36:48.328931 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 244/503] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:48 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:48.825058 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-c032b9d3-2598-42ac-a853-82392b0347a9 req-2dc08aa1-5ea0-4fa8-838a-6d4d557dd3db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95026449-87b2-4f37-bfd3-554df7e6a037", "name": "network-vif-plugged", "status": "completed", "tag": "87154a2a-cc60-4d5c-bce5-20690a774470"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:36:48.839872 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-c032b9d3-2598-42ac-a853-82392b0347a9 req-2dc08aa1-5ea0-4fa8-838a-6d4d557dd3db service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:48.840695 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-c032b9d3-2598-42ac-a853-82392b0347a9 req-2dc08aa1-5ea0-4fa8-838a-6d4d557dd3db service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:48.841371 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-c032b9d3-2598-42ac-a853-82392b0347a9 req-2dc08aa1-5ea0-4fa8-838a-6d4d557dd3db service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:48.855418 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-c032b9d3-2598-42ac-a853-82392b0347a9 req-2dc08aa1-5ea0-4fa8-838a-6d4d557dd3db service nova] Creating event network-vif-plugged:87154a2a-cc60-4d5c-bce5-20690a774470 for instance 95026449-87b2-4f37-bfd3-554df7e6a037 on hv-cinder-85426 Aug 29 20:36:48.861371 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-c032b9d3-2598-42ac-a853-82392b0347a9 req-2dc08aa1-5ea0-4fa8-838a-6d4d557dd3db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041487 Aug 29 20:36:48.862654 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 260/504] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:36:48.919490 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fe16f309-bb98-4691-b7a8-3fae93da817a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:48.920350 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fe16f309-bb98-4691-b7a8-3fae93da817a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:48.926983 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe16f309-bb98-4691-b7a8-3fae93da817a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:48.927602 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe16f309-bb98-4691-b7a8-3fae93da817a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:48.928159 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe16f309-bb98-4691-b7a8-3fae93da817a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:48.928980 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe16f309-bb98-4691-b7a8-3fae93da817a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:48.929520 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe16f309-bb98-4691-b7a8-3fae93da817a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:48.930259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe16f309-bb98-4691-b7a8-3fae93da817a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:49.083514 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-fe16f309-bb98-4691-b7a8-3fae93da817a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:49.095511 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fe16f309-bb98-4691-b7a8-3fae93da817a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1677 microversion: 2.1 time: 0.180574 Aug 29 20:36:49.102095 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 245/505] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:48 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:49.352587 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-feb69e9d-57d6-416d-8ad3-edf3cc3ae729 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:49.353575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-feb69e9d-57d6-416d-8ad3-edf3cc3ae729 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:49.360304 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-feb69e9d-57d6-416d-8ad3-edf3cc3ae729 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:49.360991 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-feb69e9d-57d6-416d-8ad3-edf3cc3ae729 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:49.361419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-feb69e9d-57d6-416d-8ad3-edf3cc3ae729 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:49.362290 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-feb69e9d-57d6-416d-8ad3-edf3cc3ae729 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:49.362740 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-feb69e9d-57d6-416d-8ad3-edf3cc3ae729 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:49.363161 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-feb69e9d-57d6-416d-8ad3-edf3cc3ae729 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:49.507679 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-feb69e9d-57d6-416d-8ad3-edf3cc3ae729 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:49.518643 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-feb69e9d-57d6-416d-8ad3-edf3cc3ae729 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:49.520419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-feb69e9d-57d6-416d-8ad3-edf3cc3ae729 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:49.521595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-feb69e9d-57d6-416d-8ad3-edf3cc3ae729 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1737 microversion: 2.20 time: 0.173342 Aug 29 20:36:49.522350 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 261/506] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:49 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:50.122693 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-646cd57b-8938-430d-a537-ec120cc189b4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:50.123915 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-646cd57b-8938-430d-a537-ec120cc189b4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:50.130656 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-646cd57b-8938-430d-a537-ec120cc189b4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:50.131342 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-646cd57b-8938-430d-a537-ec120cc189b4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:50.131963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-646cd57b-8938-430d-a537-ec120cc189b4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:50.133142 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-646cd57b-8938-430d-a537-ec120cc189b4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:50.133825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-646cd57b-8938-430d-a537-ec120cc189b4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:50.134464 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-646cd57b-8938-430d-a537-ec120cc189b4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:50.290768 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-646cd57b-8938-430d-a537-ec120cc189b4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:50.305294 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-646cd57b-8938-430d-a537-ec120cc189b4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1677 microversion: 2.1 time: 0.184069 Aug 29 20:36:50.311636 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 246/507] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:50 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:50.544302 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b7873e12-888c-42d1-baf5-ad7701ec0247 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:50.546022 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b7873e12-888c-42d1-baf5-ad7701ec0247 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:50.553350 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7873e12-888c-42d1-baf5-ad7701ec0247 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:50.553835 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7873e12-888c-42d1-baf5-ad7701ec0247 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:50.554278 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7873e12-888c-42d1-baf5-ad7701ec0247 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:50.554976 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7873e12-888c-42d1-baf5-ad7701ec0247 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:50.555990 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7873e12-888c-42d1-baf5-ad7701ec0247 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:50.556624 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7873e12-888c-42d1-baf5-ad7701ec0247 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:50.707193 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b7873e12-888c-42d1-baf5-ad7701ec0247 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:50.722532 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b7873e12-888c-42d1-baf5-ad7701ec0247 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:50.724476 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b7873e12-888c-42d1-baf5-ad7701ec0247 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:50.725669 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b7873e12-888c-42d1-baf5-ad7701ec0247 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1737 microversion: 2.20 time: 0.185419 Aug 29 20:36:50.726227 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 262/508] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:50 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:51.324705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-452166ec-bf8c-45a5-bf72-ff6d9108699a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:51.325343 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-452166ec-bf8c-45a5-bf72-ff6d9108699a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:51.332204 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-452166ec-bf8c-45a5-bf72-ff6d9108699a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:51.332669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-452166ec-bf8c-45a5-bf72-ff6d9108699a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:51.333108 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-452166ec-bf8c-45a5-bf72-ff6d9108699a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:51.333873 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-452166ec-bf8c-45a5-bf72-ff6d9108699a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:51.334344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-452166ec-bf8c-45a5-bf72-ff6d9108699a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:51.334762 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-452166ec-bf8c-45a5-bf72-ff6d9108699a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:51.477651 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-452166ec-bf8c-45a5-bf72-ff6d9108699a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:51.487767 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-452166ec-bf8c-45a5-bf72-ff6d9108699a tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1677 microversion: 2.1 time: 0.166739 Aug 29 20:36:51.488481 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 247/509] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:51 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:36:51.750728 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1b3a7673-34b8-4305-ab1e-dfc7b90c74b3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:51.752095 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1b3a7673-34b8-4305-ab1e-dfc7b90c74b3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:51.758556 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1b3a7673-34b8-4305-ab1e-dfc7b90c74b3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:51.759129 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1b3a7673-34b8-4305-ab1e-dfc7b90c74b3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:51.760221 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1b3a7673-34b8-4305-ab1e-dfc7b90c74b3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:51.760575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1b3a7673-34b8-4305-ab1e-dfc7b90c74b3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:51.761474 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1b3a7673-34b8-4305-ab1e-dfc7b90c74b3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:51.761979 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1b3a7673-34b8-4305-ab1e-dfc7b90c74b3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:51.908068 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1b3a7673-34b8-4305-ab1e-dfc7b90c74b3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:51.916217 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1b3a7673-34b8-4305-ab1e-dfc7b90c74b3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:51.917684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1b3a7673-34b8-4305-ab1e-dfc7b90c74b3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:51.918841 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1b3a7673-34b8-4305-ab1e-dfc7b90c74b3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1737 microversion: 2.20 time: 0.172246 Aug 29 20:36:51.933981 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 263/510] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:51 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:52.511772 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4c72f126-1277-4268-9c4c-84e02fbc5e26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:52.513256 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4c72f126-1277-4268-9c4c-84e02fbc5e26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:52.520123 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c72f126-1277-4268-9c4c-84e02fbc5e26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:52.520635 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c72f126-1277-4268-9c4c-84e02fbc5e26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:52.521075 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c72f126-1277-4268-9c4c-84e02fbc5e26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:52.521775 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c72f126-1277-4268-9c4c-84e02fbc5e26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:52.522232 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c72f126-1277-4268-9c4c-84e02fbc5e26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:52.522682 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c72f126-1277-4268-9c4c-84e02fbc5e26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:52.669514 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-4c72f126-1277-4268-9c4c-84e02fbc5e26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:52.677940 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4c72f126-1277-4268-9c4c-84e02fbc5e26 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1677 microversion: 2.1 time: 0.171024 Aug 29 20:36:52.678690 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 248/511] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:52 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:52.942064 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d9b6739e-1fb5-435b-b48b-523cd966eb07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:52.942672 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d9b6739e-1fb5-435b-b48b-523cd966eb07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:52.950066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d9b6739e-1fb5-435b-b48b-523cd966eb07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:52.964468 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d9b6739e-1fb5-435b-b48b-523cd966eb07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:52.965021 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d9b6739e-1fb5-435b-b48b-523cd966eb07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:52.966005 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d9b6739e-1fb5-435b-b48b-523cd966eb07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:52.966480 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d9b6739e-1fb5-435b-b48b-523cd966eb07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:52.966907 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d9b6739e-1fb5-435b-b48b-523cd966eb07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:53.131083 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d9b6739e-1fb5-435b-b48b-523cd966eb07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:53.140182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d9b6739e-1fb5-435b-b48b-523cd966eb07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:53.141692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d9b6739e-1fb5-435b-b48b-523cd966eb07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:53.143090 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d9b6739e-1fb5-435b-b48b-523cd966eb07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1737 microversion: 2.20 time: 0.205270 Aug 29 20:36:53.155963 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 264/512] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:52 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:53.700734 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f31edaa5-b157-462c-ad3c-48038cbdf870 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:53.701428 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f31edaa5-b157-462c-ad3c-48038cbdf870 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:53.708131 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f31edaa5-b157-462c-ad3c-48038cbdf870 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:53.708815 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f31edaa5-b157-462c-ad3c-48038cbdf870 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:53.709415 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f31edaa5-b157-462c-ad3c-48038cbdf870 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:53.710295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f31edaa5-b157-462c-ad3c-48038cbdf870 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:53.710756 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f31edaa5-b157-462c-ad3c-48038cbdf870 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:53.711184 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f31edaa5-b157-462c-ad3c-48038cbdf870 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:53.861756 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f31edaa5-b157-462c-ad3c-48038cbdf870 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:53.871536 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f31edaa5-b157-462c-ad3c-48038cbdf870 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1677 microversion: 2.1 time: 0.175277 Aug 29 20:36:53.872392 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 249/513] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:53 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:54.168381 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-c23ecc98-3c5f-48e2-b1a4-ef154ad895a9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:54.169220 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-c23ecc98-3c5f-48e2-b1a4-ef154ad895a9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:54.177517 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c23ecc98-3c5f-48e2-b1a4-ef154ad895a9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:54.178015 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c23ecc98-3c5f-48e2-b1a4-ef154ad895a9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:54.178449 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c23ecc98-3c5f-48e2-b1a4-ef154ad895a9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:54.179220 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c23ecc98-3c5f-48e2-b1a4-ef154ad895a9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:54.179681 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c23ecc98-3c5f-48e2-b1a4-ef154ad895a9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:54.180137 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c23ecc98-3c5f-48e2-b1a4-ef154ad895a9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:54.328447 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-c23ecc98-3c5f-48e2-b1a4-ef154ad895a9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:54.337939 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-c23ecc98-3c5f-48e2-b1a4-ef154ad895a9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:54.339498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-c23ecc98-3c5f-48e2-b1a4-ef154ad895a9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:54.340794 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c23ecc98-3c5f-48e2-b1a4-ef154ad895a9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1737 microversion: 2.20 time: 0.176952 Aug 29 20:36:54.341374 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 265/514] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:54 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:54.893584 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d5d57a12-2935-4d0f-9d0e-d8fe67f9154d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:54.894326 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d5d57a12-2935-4d0f-9d0e-d8fe67f9154d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:54.900470 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=48 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:54.903245 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5d57a12-2935-4d0f-9d0e-d8fe67f9154d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:54.904148 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5d57a12-2935-4d0f-9d0e-d8fe67f9154d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:54.904688 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5d57a12-2935-4d0f-9d0e-d8fe67f9154d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:54.905604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5d57a12-2935-4d0f-9d0e-d8fe67f9154d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:54.906313 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5d57a12-2935-4d0f-9d0e-d8fe67f9154d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:54.906978 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5d57a12-2935-4d0f-9d0e-d8fe67f9154d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:55.126411 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-d5d57a12-2935-4d0f-9d0e-d8fe67f9154d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:55.133992 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:55.144428 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d5d57a12-2935-4d0f-9d0e-d8fe67f9154d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1677 microversion: 2.1 time: 0.254556 Aug 29 20:36:55.144922 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 250/515] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:54 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1677 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:55.364919 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7ffbdf8d-3668-45b3-be47-d1d7e383c88d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:55.365648 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7ffbdf8d-3668-45b3-be47-d1d7e383c88d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:55.372196 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ffbdf8d-3668-45b3-be47-d1d7e383c88d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:55.372757 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ffbdf8d-3668-45b3-be47-d1d7e383c88d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:55.373411 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ffbdf8d-3668-45b3-be47-d1d7e383c88d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:55.374304 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ffbdf8d-3668-45b3-be47-d1d7e383c88d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:55.374858 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ffbdf8d-3668-45b3-be47-d1d7e383c88d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:55.375374 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ffbdf8d-3668-45b3-be47-d1d7e383c88d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:55.505405 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7ffbdf8d-3668-45b3-be47-d1d7e383c88d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:55.514963 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7ffbdf8d-3668-45b3-be47-d1d7e383c88d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:55.516680 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7ffbdf8d-3668-45b3-be47-d1d7e383c88d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:55.518002 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7ffbdf8d-3668-45b3-be47-d1d7e383c88d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1737 microversion: 2.20 time: 0.157210 Aug 29 20:36:55.518627 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 266/516] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:55 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:56.168163 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fddbaecf-2ac9-48e2-a4d3-49e0b2d3ad21 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:56.168777 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fddbaecf-2ac9-48e2-a4d3-49e0b2d3ad21 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:56.176451 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fddbaecf-2ac9-48e2-a4d3-49e0b2d3ad21 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:56.176864 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fddbaecf-2ac9-48e2-a4d3-49e0b2d3ad21 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:56.177303 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fddbaecf-2ac9-48e2-a4d3-49e0b2d3ad21 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:56.178046 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fddbaecf-2ac9-48e2-a4d3-49e0b2d3ad21 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:56.178504 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fddbaecf-2ac9-48e2-a4d3-49e0b2d3ad21 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:56.178928 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fddbaecf-2ac9-48e2-a4d3-49e0b2d3ad21 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:56.480876 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-fddbaecf-2ac9-48e2-a4d3-49e0b2d3ad21 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:56.488940 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fddbaecf-2ac9-48e2-a4d3-49e0b2d3ad21 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1677 microversion: 2.1 time: 0.326391 Aug 29 20:36:56.489612 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 251/517] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:56 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1677 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:56.541064 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1c65014f-075e-4a0a-8beb-1430cd899db5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:56.541696 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1c65014f-075e-4a0a-8beb-1430cd899db5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:56.548270 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1c65014f-075e-4a0a-8beb-1430cd899db5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:56.548757 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1c65014f-075e-4a0a-8beb-1430cd899db5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:56.549195 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1c65014f-075e-4a0a-8beb-1430cd899db5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:56.549896 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1c65014f-075e-4a0a-8beb-1430cd899db5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:56.550354 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1c65014f-075e-4a0a-8beb-1430cd899db5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:56.550775 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1c65014f-075e-4a0a-8beb-1430cd899db5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:56.686392 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1c65014f-075e-4a0a-8beb-1430cd899db5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:56.695137 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1c65014f-075e-4a0a-8beb-1430cd899db5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:56.696655 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1c65014f-075e-4a0a-8beb-1430cd899db5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:56.698387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1c65014f-075e-4a0a-8beb-1430cd899db5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1719 microversion: 2.20 time: 0.161313 Aug 29 20:36:56.698945 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 267/518] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:56 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:57.510460 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-018a5aa6-744d-4b97-b3d2-1e29bddb4c29 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:57.511076 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-018a5aa6-744d-4b97-b3d2-1e29bddb4c29 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:57.518012 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-018a5aa6-744d-4b97-b3d2-1e29bddb4c29 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:57.518499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-018a5aa6-744d-4b97-b3d2-1e29bddb4c29 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:57.518934 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-018a5aa6-744d-4b97-b3d2-1e29bddb4c29 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:57.519633 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-018a5aa6-744d-4b97-b3d2-1e29bddb4c29 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:57.520125 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-018a5aa6-744d-4b97-b3d2-1e29bddb4c29 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:57.520554 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-018a5aa6-744d-4b97-b3d2-1e29bddb4c29 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:57.651918 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-018a5aa6-744d-4b97-b3d2-1e29bddb4c29 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:57.661000 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-018a5aa6-744d-4b97-b3d2-1e29bddb4c29 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1677 microversion: 2.1 time: 0.154532 Aug 29 20:36:57.661576 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 252/519] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:57 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:57.721267 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-be64eb8f-295d-474c-9656-975f7a2c2119 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:57.721858 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-be64eb8f-295d-474c-9656-975f7a2c2119 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:57.728263 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-be64eb8f-295d-474c-9656-975f7a2c2119 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:57.729277 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-be64eb8f-295d-474c-9656-975f7a2c2119 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:57.729704 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-be64eb8f-295d-474c-9656-975f7a2c2119 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:57.730383 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-be64eb8f-295d-474c-9656-975f7a2c2119 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:57.730826 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-be64eb8f-295d-474c-9656-975f7a2c2119 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:57.731241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-be64eb8f-295d-474c-9656-975f7a2c2119 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:57.864014 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-be64eb8f-295d-474c-9656-975f7a2c2119 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:57.873040 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-be64eb8f-295d-474c-9656-975f7a2c2119 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:57.874496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-be64eb8f-295d-474c-9656-975f7a2c2119 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:57.875652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-be64eb8f-295d-474c-9656-975f7a2c2119 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1719 microversion: 2.20 time: 0.158221 Aug 29 20:36:57.876241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 268/520] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:57 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:58.683109 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6cc6ebe2-6f5a-446c-acf2-bd1dfd739923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:58.683674 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6cc6ebe2-6f5a-446c-acf2-bd1dfd739923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:58.690341 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cc6ebe2-6f5a-446c-acf2-bd1dfd739923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:58.690823 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cc6ebe2-6f5a-446c-acf2-bd1dfd739923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:58.691261 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cc6ebe2-6f5a-446c-acf2-bd1dfd739923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:58.692263 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cc6ebe2-6f5a-446c-acf2-bd1dfd739923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:58.692432 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cc6ebe2-6f5a-446c-acf2-bd1dfd739923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:58.692857 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6cc6ebe2-6f5a-446c-acf2-bd1dfd739923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:58.821463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6cc6ebe2-6f5a-446c-acf2-bd1dfd739923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:58.829712 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6cc6ebe2-6f5a-446c-acf2-bd1dfd739923 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1677 microversion: 2.1 time: 0.151105 Aug 29 20:36:58.830271 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 253/521] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:58 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:36:58.899742 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4fc83eb0-9917-41e2-bd12-53dc8f181f18 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:58.900378 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4fc83eb0-9917-41e2-bd12-53dc8f181f18 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:58.907715 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fc83eb0-9917-41e2-bd12-53dc8f181f18 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:58.908246 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fc83eb0-9917-41e2-bd12-53dc8f181f18 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:58.908686 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fc83eb0-9917-41e2-bd12-53dc8f181f18 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:58.909389 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fc83eb0-9917-41e2-bd12-53dc8f181f18 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:58.909845 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fc83eb0-9917-41e2-bd12-53dc8f181f18 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:58.910273 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fc83eb0-9917-41e2-bd12-53dc8f181f18 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:59.041467 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4fc83eb0-9917-41e2-bd12-53dc8f181f18 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:59.049608 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4fc83eb0-9917-41e2-bd12-53dc8f181f18 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:59.051040 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4fc83eb0-9917-41e2-bd12-53dc8f181f18 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:36:59.052262 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4fc83eb0-9917-41e2-bd12-53dc8f181f18 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1719 microversion: 2.20 time: 0.156388 Aug 29 20:36:59.052873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 269/522] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:36:58 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:36:59.850597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-efbcc4b7-3edd-4558-8147-682782430539 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:36:59.851194 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-efbcc4b7-3edd-4558-8147-682782430539 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:36:59.858362 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-efbcc4b7-3edd-4558-8147-682782430539 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:59.858828 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-efbcc4b7-3edd-4558-8147-682782430539 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:59.859260 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-efbcc4b7-3edd-4558-8147-682782430539 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:59.859971 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-efbcc4b7-3edd-4558-8147-682782430539 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:36:59.860420 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-efbcc4b7-3edd-4558-8147-682782430539 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:36:59.860834 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-efbcc4b7-3edd-4558-8147-682782430539 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:36:59.993909 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-efbcc4b7-3edd-4558-8147-682782430539 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:00.004665 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-efbcc4b7-3edd-4558-8147-682782430539 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1654 microversion: 2.1 time: 0.157892 Aug 29 20:37:00.005244 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 254/523] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:36:59 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:00.027144 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-c6636e0b-867d-4b3d-9823-e0ffe49fc2bd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:00.033640 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c6636e0b-867d-4b3d-9823-e0ffe49fc2bd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:00.034128 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c6636e0b-867d-4b3d-9823-e0ffe49fc2bd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:00.034569 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c6636e0b-867d-4b3d-9823-e0ffe49fc2bd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:00.060159 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-c6636e0b-867d-4b3d-9823-e0ffe49fc2bd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Going to try to start instance {{(pid=127027) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 20:37:00.076372 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0a3c7b05-96d5-4c5d-9454-65fd4920cc0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:00.077078 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0a3c7b05-96d5-4c5d-9454-65fd4920cc0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:00.082837 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a3c7b05-96d5-4c5d-9454-65fd4920cc0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:00.083312 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a3c7b05-96d5-4c5d-9454-65fd4920cc0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:00.083743 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a3c7b05-96d5-4c5d-9454-65fd4920cc0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:00.084474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a3c7b05-96d5-4c5d-9454-65fd4920cc0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:00.084921 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a3c7b05-96d5-4c5d-9454-65fd4920cc0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:00.085335 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0a3c7b05-96d5-4c5d-9454-65fd4920cc0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:00.103966 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c6636e0b-867d-4b3d-9823-e0ffe49fc2bd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "POST /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/action" status: 202 len: 0 microversion: 2.1 time: 0.080955 Aug 29 20:37:00.108234 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 270/524] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 29 20:37:00 2022] POST /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:37:00.114165 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-3939b91b-8277-4dfe-9f98-5ceaafab4776 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:00.114867 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-3939b91b-8277-4dfe-9f98-5ceaafab4776 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:00.121036 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3939b91b-8277-4dfe-9f98-5ceaafab4776 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:00.121771 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3939b91b-8277-4dfe-9f98-5ceaafab4776 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:00.122192 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3939b91b-8277-4dfe-9f98-5ceaafab4776 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:00.122921 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3939b91b-8277-4dfe-9f98-5ceaafab4776 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:00.123338 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3939b91b-8277-4dfe-9f98-5ceaafab4776 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:00.123753 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3939b91b-8277-4dfe-9f98-5ceaafab4776 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:00.263130 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-3939b91b-8277-4dfe-9f98-5ceaafab4776 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:00.265977 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0a3c7b05-96d5-4c5d-9454-65fd4920cc0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:00.271121 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-3939b91b-8277-4dfe-9f98-5ceaafab4776 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1663 microversion: 2.1 time: 0.161539 Aug 29 20:37:00.271728 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 271/525] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:00 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:37:00.276042 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0a3c7b05-96d5-4c5d-9454-65fd4920cc0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:00.276042 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0a3c7b05-96d5-4c5d-9454-65fd4920cc0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:00.277421 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0a3c7b05-96d5-4c5d-9454-65fd4920cc0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1662 microversion: 2.20 time: 0.205444 Aug 29 20:37:00.277964 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 255/526] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:00 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1662 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:37:00.299391 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-3fa09549-7c3b-4117-9632-3b838491a7e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e72a884-754c-4b9d-996e-862a7df189eb"}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:00.301904 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-3fa09549-7c3b-4117-9632-3b838491a7e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:00.307924 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3fa09549-7c3b-4117-9632-3b838491a7e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:00.308431 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3fa09549-7c3b-4117-9632-3b838491a7e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:00.308857 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3fa09549-7c3b-4117-9632-3b838491a7e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:00.309545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3fa09549-7c3b-4117-9632-3b838491a7e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:00.309989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3fa09549-7c3b-4117-9632-3b838491a7e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:00.310664 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3fa09549-7c3b-4117-9632-3b838491a7e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:00.328014 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:00.601874 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-3fa09549-7c3b-4117-9632-3b838491a7e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "POST /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306248 Aug 29 20:37:00.602481 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 272/527] 10.222.0.18 () {62 vars in 1364 bytes} [Mon Aug 29 20:37:00 2022] POST /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:37:00.733520 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3d634088-dda9-4b94-ba17-1eaaa22779c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:00.734135 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3d634088-dda9-4b94-ba17-1eaaa22779c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:00.741216 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d634088-dda9-4b94-ba17-1eaaa22779c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:00.742066 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d634088-dda9-4b94-ba17-1eaaa22779c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:00.742512 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d634088-dda9-4b94-ba17-1eaaa22779c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:00.743221 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d634088-dda9-4b94-ba17-1eaaa22779c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:00.743764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d634088-dda9-4b94-ba17-1eaaa22779c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:00.744300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d634088-dda9-4b94-ba17-1eaaa22779c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:00.799024 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3d634088-dda9-4b94-ba17-1eaaa22779c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127028) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 20:37:00.805374 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-095b1132-bc77-4c3f-b4d7-bc8e60de9d3c req-739e5a28-5267-41e7-8efa-db1a00e3b058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95026449-87b2-4f37-bfd3-554df7e6a037", "name": "network-vif-unplugged", "status": "completed", "tag": "87154a2a-cc60-4d5c-bce5-20690a774470"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:00.819839 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-095b1132-bc77-4c3f-b4d7-bc8e60de9d3c req-739e5a28-5267-41e7-8efa-db1a00e3b058 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:00.820630 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-095b1132-bc77-4c3f-b4d7-bc8e60de9d3c req-739e5a28-5267-41e7-8efa-db1a00e3b058 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:00.821319 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-095b1132-bc77-4c3f-b4d7-bc8e60de9d3c req-739e5a28-5267-41e7-8efa-db1a00e3b058 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:00.832313 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.compute.server_external_events [req-095b1132-bc77-4c3f-b4d7-bc8e60de9d3c req-739e5a28-5267-41e7-8efa-db1a00e3b058 service nova] Unable to find a host for instance 95026449-87b2-4f37-bfd3-554df7e6a037. Dropping event network-vif-unplugged {{(pid=127027) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 20:37:00.833231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-095b1132-bc77-4c3f-b4d7-bc8e60de9d3c req-739e5a28-5267-41e7-8efa-db1a00e3b058 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031892 Aug 29 20:37:00.833962 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 273/528] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 29 20:37:00.883886 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3d634088-dda9-4b94-ba17-1eaaa22779c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "POST /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/action" status: 202 len: 0 microversion: 2.20 time: 0.153975 Aug 29 20:37:00.888193 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 256/529] 10.222.0.18 () {62 vars in 1319 bytes} [Mon Aug 29 20:37:00 2022] POST /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:37:00.895066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ce9a085e-4413-4a37-be77-3098339b60a3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:00.895678 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ce9a085e-4413-4a37-be77-3098339b60a3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:00.901635 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ce9a085e-4413-4a37-be77-3098339b60a3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:00.902118 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ce9a085e-4413-4a37-be77-3098339b60a3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:00.902549 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ce9a085e-4413-4a37-be77-3098339b60a3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:00.903245 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ce9a085e-4413-4a37-be77-3098339b60a3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:00.903695 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ce9a085e-4413-4a37-be77-3098339b60a3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:00.904160 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ce9a085e-4413-4a37-be77-3098339b60a3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:01.040352 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-ce9a085e-4413-4a37-be77-3098339b60a3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:01.053232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-ce9a085e-4413-4a37-be77-3098339b60a3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:01.054662 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-ce9a085e-4413-4a37-be77-3098339b60a3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:01.055828 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ce9a085e-4413-4a37-be77-3098339b60a3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1748 microversion: 2.20 time: 0.164695 Aug 29 20:37:01.056414 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 274/530] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:00 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:01.293622 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b6bfb2a6-fc95-4b6b-a748-6e45ce1125f6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:01.294834 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b6bfb2a6-fc95-4b6b-a748-6e45ce1125f6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:01.300849 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6bfb2a6-fc95-4b6b-a748-6e45ce1125f6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:01.301327 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6bfb2a6-fc95-4b6b-a748-6e45ce1125f6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:01.301761 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6bfb2a6-fc95-4b6b-a748-6e45ce1125f6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:01.302648 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6bfb2a6-fc95-4b6b-a748-6e45ce1125f6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:01.303246 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6bfb2a6-fc95-4b6b-a748-6e45ce1125f6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:01.303809 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b6bfb2a6-fc95-4b6b-a748-6e45ce1125f6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:01.470507 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-b6bfb2a6-fc95-4b6b-a748-6e45ce1125f6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:01.479337 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b6bfb2a6-fc95-4b6b-a748-6e45ce1125f6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1663 microversion: 2.1 time: 0.190240 Aug 29 20:37:01.480505 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 257/531] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:01 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1663 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:01.545195 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-da5eeefd-142d-454c-b6b2-730899274889 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fdb7e42-0867-478e-8b1f-42724c027963"}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:01.547875 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-da5eeefd-142d-454c-b6b2-730899274889 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:01.554397 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da5eeefd-142d-454c-b6b2-730899274889 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:01.554983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da5eeefd-142d-454c-b6b2-730899274889 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:01.555524 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da5eeefd-142d-454c-b6b2-730899274889 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:01.556561 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da5eeefd-142d-454c-b6b2-730899274889 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:01.557103 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da5eeefd-142d-454c-b6b2-730899274889 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:01.557722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da5eeefd-142d-454c-b6b2-730899274889 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:02.080577 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-841f9a4c-7776-4414-8156-d7d9a4e65c92 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:02.081308 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-841f9a4c-7776-4414-8156-d7d9a4e65c92 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:02.089171 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-841f9a4c-7776-4414-8156-d7d9a4e65c92 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:02.089670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-841f9a4c-7776-4414-8156-d7d9a4e65c92 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:02.090123 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-841f9a4c-7776-4414-8156-d7d9a4e65c92 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:02.090972 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-841f9a4c-7776-4414-8156-d7d9a4e65c92 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:02.091495 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-841f9a4c-7776-4414-8156-d7d9a4e65c92 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:02.091924 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-841f9a4c-7776-4414-8156-d7d9a4e65c92 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:02.218753 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-da5eeefd-142d-454c-b6b2-730899274889 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "POST /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.678077 Aug 29 20:37:02.219638 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 275/532] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 29 20:37:01 2022] POST /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-volume_attachments => generated 194 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:37:02.271286 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-841f9a4c-7776-4414-8156-d7d9a4e65c92 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:02.287387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-841f9a4c-7776-4414-8156-d7d9a4e65c92 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:02.288949 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-841f9a4c-7776-4414-8156-d7d9a4e65c92 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:02.290150 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-841f9a4c-7776-4414-8156-d7d9a4e65c92 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1748 microversion: 2.20 time: 0.213554 Aug 29 20:37:02.290710 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 258/533] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:02 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1748 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:37:02.502684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-61474886-40a0-4397-bf96-0cef7c641132 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:02.503411 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-61474886-40a0-4397-bf96-0cef7c641132 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:02.510346 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61474886-40a0-4397-bf96-0cef7c641132 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:02.510827 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61474886-40a0-4397-bf96-0cef7c641132 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:02.511261 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61474886-40a0-4397-bf96-0cef7c641132 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:02.512058 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61474886-40a0-4397-bf96-0cef7c641132 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:02.512514 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61474886-40a0-4397-bf96-0cef7c641132 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:02.512936 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61474886-40a0-4397-bf96-0cef7c641132 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:02.650559 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-61474886-40a0-4397-bf96-0cef7c641132 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:02.659153 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-61474886-40a0-4397-bf96-0cef7c641132 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1667 microversion: 2.1 time: 0.160653 Aug 29 20:37:02.659724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 276/534] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:02 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:03.315751 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dd636229-221d-4914-a453-16128c95771a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:03.316395 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dd636229-221d-4914-a453-16128c95771a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:03.324074 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd636229-221d-4914-a453-16128c95771a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:03.324756 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd636229-221d-4914-a453-16128c95771a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:03.325686 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd636229-221d-4914-a453-16128c95771a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:03.326496 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd636229-221d-4914-a453-16128c95771a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:03.327124 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd636229-221d-4914-a453-16128c95771a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:03.327558 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dd636229-221d-4914-a453-16128c95771a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:03.483838 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-dd636229-221d-4914-a453-16128c95771a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:03.492408 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-dd636229-221d-4914-a453-16128c95771a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:03.493831 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-dd636229-221d-4914-a453-16128c95771a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:03.495577 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dd636229-221d-4914-a453-16128c95771a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.184031 Aug 29 20:37:03.496223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 259/535] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:03 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:04.519069 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-af07e786-5ee9-4570-bf33-1db6f1b1ff4f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:04.519701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-af07e786-5ee9-4570-bf33-1db6f1b1ff4f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:04.522201 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=56 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:04.527558 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-af07e786-5ee9-4570-bf33-1db6f1b1ff4f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:04.528067 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-af07e786-5ee9-4570-bf33-1db6f1b1ff4f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:04.528565 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-af07e786-5ee9-4570-bf33-1db6f1b1ff4f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:04.529418 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-af07e786-5ee9-4570-bf33-1db6f1b1ff4f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:04.530122 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-af07e786-5ee9-4570-bf33-1db6f1b1ff4f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:04.530727 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-af07e786-5ee9-4570-bf33-1db6f1b1ff4f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:04.675908 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-af07e786-5ee9-4570-bf33-1db6f1b1ff4f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:04.685903 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-af07e786-5ee9-4570-bf33-1db6f1b1ff4f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:04.687411 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-af07e786-5ee9-4570-bf33-1db6f1b1ff4f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:04.688594 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-af07e786-5ee9-4570-bf33-1db6f1b1ff4f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.173525 Aug 29 20:37:04.689134 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 277/536] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:04 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:05.710866 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e880adf1-50e8-478f-a349-c8e9c14ba045 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:05.711479 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e880adf1-50e8-478f-a349-c8e9c14ba045 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:05.719515 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e880adf1-50e8-478f-a349-c8e9c14ba045 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:05.720030 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e880adf1-50e8-478f-a349-c8e9c14ba045 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:05.720796 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e880adf1-50e8-478f-a349-c8e9c14ba045 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:05.721501 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e880adf1-50e8-478f-a349-c8e9c14ba045 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:05.722443 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e880adf1-50e8-478f-a349-c8e9c14ba045 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:05.722909 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e880adf1-50e8-478f-a349-c8e9c14ba045 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:05.861883 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e880adf1-50e8-478f-a349-c8e9c14ba045 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:05.871645 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e880adf1-50e8-478f-a349-c8e9c14ba045 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:05.873203 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e880adf1-50e8-478f-a349-c8e9c14ba045 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:05.874437 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e880adf1-50e8-478f-a349-c8e9c14ba045 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.167581 Aug 29 20:37:05.874995 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 260/537] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:05 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:06.901174 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2bdbf6f7-a348-4fe1-a010-b6a3c3c15feb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:06.901792 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2bdbf6f7-a348-4fe1-a010-b6a3c3c15feb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:06.912179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2bdbf6f7-a348-4fe1-a010-b6a3c3c15feb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:06.912682 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2bdbf6f7-a348-4fe1-a010-b6a3c3c15feb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:06.913122 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2bdbf6f7-a348-4fe1-a010-b6a3c3c15feb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:06.913842 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2bdbf6f7-a348-4fe1-a010-b6a3c3c15feb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:06.914338 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2bdbf6f7-a348-4fe1-a010-b6a3c3c15feb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:06.914821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2bdbf6f7-a348-4fe1-a010-b6a3c3c15feb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:07.075367 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2bdbf6f7-a348-4fe1-a010-b6a3c3c15feb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:07.086776 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2bdbf6f7-a348-4fe1-a010-b6a3c3c15feb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:07.090499 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2bdbf6f7-a348-4fe1-a010-b6a3c3c15feb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:07.090499 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2bdbf6f7-a348-4fe1-a010-b6a3c3c15feb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.192517 Aug 29 20:37:07.091706 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 278/538] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:06 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:37:08.115924 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae29c948-818c-4ab6-8c97-446b18bf4cbe tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:08.116595 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ae29c948-818c-4ab6-8c97-446b18bf4cbe tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:08.123657 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae29c948-818c-4ab6-8c97-446b18bf4cbe tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:08.124216 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae29c948-818c-4ab6-8c97-446b18bf4cbe tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:08.124662 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae29c948-818c-4ab6-8c97-446b18bf4cbe tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:08.125353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae29c948-818c-4ab6-8c97-446b18bf4cbe tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:08.125812 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae29c948-818c-4ab6-8c97-446b18bf4cbe tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:08.126232 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae29c948-818c-4ab6-8c97-446b18bf4cbe tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:08.269755 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae29c948-818c-4ab6-8c97-446b18bf4cbe tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:08.279513 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae29c948-818c-4ab6-8c97-446b18bf4cbe tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:08.281016 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae29c948-818c-4ab6-8c97-446b18bf4cbe tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:08.282199 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ae29c948-818c-4ab6-8c97-446b18bf4cbe tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.170484 Aug 29 20:37:08.282756 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 261/539] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:08 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:09.307563 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1460a41e-3ff0-4894-9201-cdbff1832229 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:09.309484 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1460a41e-3ff0-4894-9201-cdbff1832229 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:09.316199 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1460a41e-3ff0-4894-9201-cdbff1832229 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:09.316705 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1460a41e-3ff0-4894-9201-cdbff1832229 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:09.317132 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1460a41e-3ff0-4894-9201-cdbff1832229 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:09.317826 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1460a41e-3ff0-4894-9201-cdbff1832229 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:09.318376 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1460a41e-3ff0-4894-9201-cdbff1832229 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:09.318821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1460a41e-3ff0-4894-9201-cdbff1832229 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:09.462003 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1460a41e-3ff0-4894-9201-cdbff1832229 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:09.470833 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1460a41e-3ff0-4894-9201-cdbff1832229 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:09.472329 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1460a41e-3ff0-4894-9201-cdbff1832229 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:09.473491 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1460a41e-3ff0-4894-9201-cdbff1832229 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.171671 Aug 29 20:37:09.474043 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 279/540] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:09 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:10.496275 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c575aef5-9480-42b9-a03b-6d31de668fbd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:10.496881 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c575aef5-9480-42b9-a03b-6d31de668fbd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:10.503388 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c575aef5-9480-42b9-a03b-6d31de668fbd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:10.503867 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c575aef5-9480-42b9-a03b-6d31de668fbd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:10.504448 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c575aef5-9480-42b9-a03b-6d31de668fbd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:10.505143 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c575aef5-9480-42b9-a03b-6d31de668fbd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:10.505604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c575aef5-9480-42b9-a03b-6d31de668fbd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:10.506029 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c575aef5-9480-42b9-a03b-6d31de668fbd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:10.657032 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c575aef5-9480-42b9-a03b-6d31de668fbd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:10.666138 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c575aef5-9480-42b9-a03b-6d31de668fbd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:10.667712 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c575aef5-9480-42b9-a03b-6d31de668fbd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:10.669558 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c575aef5-9480-42b9-a03b-6d31de668fbd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.177345 Aug 29 20:37:10.670122 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 262/541] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:10 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:11.693808 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a10936b5-c317-4890-b355-4f14857f068d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:11.694511 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a10936b5-c317-4890-b355-4f14857f068d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:11.701634 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a10936b5-c317-4890-b355-4f14857f068d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:11.702114 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a10936b5-c317-4890-b355-4f14857f068d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:11.702722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a10936b5-c317-4890-b355-4f14857f068d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:11.703288 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a10936b5-c317-4890-b355-4f14857f068d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:11.703736 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a10936b5-c317-4890-b355-4f14857f068d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:11.704259 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a10936b5-c317-4890-b355-4f14857f068d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:11.847499 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a10936b5-c317-4890-b355-4f14857f068d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:11.856663 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a10936b5-c317-4890-b355-4f14857f068d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:11.867254 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a10936b5-c317-4890-b355-4f14857f068d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:11.869303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a10936b5-c317-4890-b355-4f14857f068d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.179167 Aug 29 20:37:11.869991 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 280/542] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:11 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:12.904034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ae60ddf-e424-448b-9ddb-a87d17a43517 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:12.904034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ae60ddf-e424-448b-9ddb-a87d17a43517 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:12.904034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ae60ddf-e424-448b-9ddb-a87d17a43517 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:12.904034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ae60ddf-e424-448b-9ddb-a87d17a43517 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:12.904830 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ae60ddf-e424-448b-9ddb-a87d17a43517 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:12.905426 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ae60ddf-e424-448b-9ddb-a87d17a43517 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:12.905890 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ae60ddf-e424-448b-9ddb-a87d17a43517 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:12.906315 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ae60ddf-e424-448b-9ddb-a87d17a43517 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:13.048649 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ae60ddf-e424-448b-9ddb-a87d17a43517 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:13.058303 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ae60ddf-e424-448b-9ddb-a87d17a43517 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:13.060071 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ae60ddf-e424-448b-9ddb-a87d17a43517 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:13.061545 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ae60ddf-e424-448b-9ddb-a87d17a43517 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.170732 Aug 29 20:37:13.062142 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 263/543] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:12 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:13.409844 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-79d7d5d3-597f-4e33-a72b-9ce159c8602f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:13.413059 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-79d7d5d3-597f-4e33-a72b-9ce159c8602f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:13.420276 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-79d7d5d3-597f-4e33-a72b-9ce159c8602f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:13.420776 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-79d7d5d3-597f-4e33-a72b-9ce159c8602f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:13.421213 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-79d7d5d3-597f-4e33-a72b-9ce159c8602f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:13.421922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-79d7d5d3-597f-4e33-a72b-9ce159c8602f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:13.422376 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-79d7d5d3-597f-4e33-a72b-9ce159c8602f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:13.422800 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-79d7d5d3-597f-4e33-a72b-9ce159c8602f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:13.513770 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-79d7d5d3-597f-4e33-a72b-9ce159c8602f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "POST /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/action" status: 202 len: 0 microversion: 2.1 time: 0.107595 Aug 29 20:37:13.514727 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 281/544] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 29 20:37:13 2022] POST /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:37:13.524940 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c0b565a1-8255-4fd1-8dd2-d3a0dff9bf18 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:13.525555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c0b565a1-8255-4fd1-8dd2-d3a0dff9bf18 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:13.533712 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0b565a1-8255-4fd1-8dd2-d3a0dff9bf18 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:13.534447 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0b565a1-8255-4fd1-8dd2-d3a0dff9bf18 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:13.535106 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0b565a1-8255-4fd1-8dd2-d3a0dff9bf18 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:13.536250 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0b565a1-8255-4fd1-8dd2-d3a0dff9bf18 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:13.536941 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0b565a1-8255-4fd1-8dd2-d3a0dff9bf18 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:13.537587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c0b565a1-8255-4fd1-8dd2-d3a0dff9bf18 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:13.722179 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c0b565a1-8255-4fd1-8dd2-d3a0dff9bf18 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:13.731621 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c0b565a1-8255-4fd1-8dd2-d3a0dff9bf18 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1751 microversion: 2.1 time: 0.210523 Aug 29 20:37:13.732236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 264/545] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:13 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:14.086385 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8ca1881b-8d30-49b7-a393-f09974799554 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:14.087112 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8ca1881b-8d30-49b7-a393-f09974799554 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:14.094229 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8ca1881b-8d30-49b7-a393-f09974799554 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:14.094729 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8ca1881b-8d30-49b7-a393-f09974799554 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:14.095164 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8ca1881b-8d30-49b7-a393-f09974799554 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:14.095857 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8ca1881b-8d30-49b7-a393-f09974799554 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:14.096469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8ca1881b-8d30-49b7-a393-f09974799554 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:14.096888 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8ca1881b-8d30-49b7-a393-f09974799554 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:14.239514 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8ca1881b-8d30-49b7-a393-f09974799554 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:14.248874 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8ca1881b-8d30-49b7-a393-f09974799554 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:14.250349 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8ca1881b-8d30-49b7-a393-f09974799554 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:14.251532 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8ca1881b-8d30-49b7-a393-f09974799554 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.169735 Aug 29 20:37:14.252121 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 282/546] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:14 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:14.754136 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-05d30fa1-bdf4-44bc-9a37-1d98dd527cf7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:14.755170 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-05d30fa1-bdf4-44bc-9a37-1d98dd527cf7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:14.762183 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05d30fa1-bdf4-44bc-9a37-1d98dd527cf7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:14.762867 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05d30fa1-bdf4-44bc-9a37-1d98dd527cf7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:14.763311 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05d30fa1-bdf4-44bc-9a37-1d98dd527cf7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:14.764047 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05d30fa1-bdf4-44bc-9a37-1d98dd527cf7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:14.764638 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05d30fa1-bdf4-44bc-9a37-1d98dd527cf7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:14.765247 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05d30fa1-bdf4-44bc-9a37-1d98dd527cf7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:14.923050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-05d30fa1-bdf4-44bc-9a37-1d98dd527cf7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:14.931705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-05d30fa1-bdf4-44bc-9a37-1d98dd527cf7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1751 microversion: 2.1 time: 0.182189 Aug 29 20:37:14.932328 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 265/547] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:14 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:15.275244 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a4044d1f-d18e-4338-ae59-25f0f939c5a4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:15.276096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a4044d1f-d18e-4338-ae59-25f0f939c5a4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:15.283501 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a4044d1f-d18e-4338-ae59-25f0f939c5a4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:15.285173 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a4044d1f-d18e-4338-ae59-25f0f939c5a4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:15.285173 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a4044d1f-d18e-4338-ae59-25f0f939c5a4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:15.289745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a4044d1f-d18e-4338-ae59-25f0f939c5a4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:15.289745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a4044d1f-d18e-4338-ae59-25f0f939c5a4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:15.289745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a4044d1f-d18e-4338-ae59-25f0f939c5a4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:15.679882 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a4044d1f-d18e-4338-ae59-25f0f939c5a4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:15.688950 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a4044d1f-d18e-4338-ae59-25f0f939c5a4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:15.690398 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a4044d1f-d18e-4338-ae59-25f0f939c5a4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:15.691628 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a4044d1f-d18e-4338-ae59-25f0f939c5a4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.420772 Aug 29 20:37:15.692272 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 283/548] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:15 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:15.962262 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-03bb167e-8b46-4fce-979f-387159af5437 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:15.963391 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-03bb167e-8b46-4fce-979f-387159af5437 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:15.971286 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03bb167e-8b46-4fce-979f-387159af5437 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:15.971764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03bb167e-8b46-4fce-979f-387159af5437 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:15.972245 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03bb167e-8b46-4fce-979f-387159af5437 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:15.972955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03bb167e-8b46-4fce-979f-387159af5437 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:15.973403 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03bb167e-8b46-4fce-979f-387159af5437 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:15.973822 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-03bb167e-8b46-4fce-979f-387159af5437 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:15.992802 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:16.176415 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-03bb167e-8b46-4fce-979f-387159af5437 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:16.186739 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-03bb167e-8b46-4fce-979f-387159af5437 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1751 microversion: 2.1 time: 0.228415 Aug 29 20:37:16.187814 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 266/549] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:15 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1751 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:16.716173 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-3dda1c60-2552-45a3-b439-e2360a6804a7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:16.716923 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-3dda1c60-2552-45a3-b439-e2360a6804a7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:16.727449 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3dda1c60-2552-45a3-b439-e2360a6804a7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:16.728474 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3dda1c60-2552-45a3-b439-e2360a6804a7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:16.729183 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3dda1c60-2552-45a3-b439-e2360a6804a7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:16.730788 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3dda1c60-2552-45a3-b439-e2360a6804a7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:16.731507 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3dda1c60-2552-45a3-b439-e2360a6804a7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:16.732479 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3dda1c60-2552-45a3-b439-e2360a6804a7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:16.893356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-3dda1c60-2552-45a3-b439-e2360a6804a7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:16.899460 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:16.909873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-3dda1c60-2552-45a3-b439-e2360a6804a7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:16.911315 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-3dda1c60-2552-45a3-b439-e2360a6804a7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:16.912550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-3dda1c60-2552-45a3-b439-e2360a6804a7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.200658 Aug 29 20:37:16.913315 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 284/550] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:16 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:17.210188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e8817ab5-1516-466b-a685-a649b04cf0a3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:17.210937 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e8817ab5-1516-466b-a685-a649b04cf0a3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:17.218122 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8817ab5-1516-466b-a685-a649b04cf0a3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:17.220071 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8817ab5-1516-466b-a685-a649b04cf0a3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:17.220528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8817ab5-1516-466b-a685-a649b04cf0a3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:17.221277 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8817ab5-1516-466b-a685-a649b04cf0a3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:17.221738 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8817ab5-1516-466b-a685-a649b04cf0a3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:17.222161 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e8817ab5-1516-466b-a685-a649b04cf0a3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:17.383549 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e8817ab5-1516-466b-a685-a649b04cf0a3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:17.392757 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e8817ab5-1516-466b-a685-a649b04cf0a3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1751 microversion: 2.1 time: 0.187006 Aug 29 20:37:17.393527 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 267/551] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:17 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:17.938600 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-536ebb83-2995-4254-9b86-38f87eae2cb6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:17.939300 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-536ebb83-2995-4254-9b86-38f87eae2cb6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:17.946601 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-536ebb83-2995-4254-9b86-38f87eae2cb6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:17.947088 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-536ebb83-2995-4254-9b86-38f87eae2cb6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:17.947522 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-536ebb83-2995-4254-9b86-38f87eae2cb6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:17.948260 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-536ebb83-2995-4254-9b86-38f87eae2cb6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:17.948764 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-536ebb83-2995-4254-9b86-38f87eae2cb6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:17.949773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-536ebb83-2995-4254-9b86-38f87eae2cb6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:18.094888 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-536ebb83-2995-4254-9b86-38f87eae2cb6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:18.103635 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-536ebb83-2995-4254-9b86-38f87eae2cb6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:18.105094 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-536ebb83-2995-4254-9b86-38f87eae2cb6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:18.106760 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-536ebb83-2995-4254-9b86-38f87eae2cb6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.173198 Aug 29 20:37:18.107323 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 285/552] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:17 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:18.417016 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-84026096-8f6f-43c5-9000-e332122d3bb3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:18.417652 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-84026096-8f6f-43c5-9000-e332122d3bb3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:18.424274 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84026096-8f6f-43c5-9000-e332122d3bb3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:18.424696 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84026096-8f6f-43c5-9000-e332122d3bb3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:18.425124 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84026096-8f6f-43c5-9000-e332122d3bb3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:18.425816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84026096-8f6f-43c5-9000-e332122d3bb3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:18.426265 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84026096-8f6f-43c5-9000-e332122d3bb3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:18.426710 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-84026096-8f6f-43c5-9000-e332122d3bb3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:18.576303 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-84026096-8f6f-43c5-9000-e332122d3bb3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:18.588799 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-84026096-8f6f-43c5-9000-e332122d3bb3 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1751 microversion: 2.1 time: 0.175822 Aug 29 20:37:18.589377 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 268/553] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:18 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:19.132299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8ff499be-6a7e-4953-b25a-4a877463f0b5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:19.132896 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8ff499be-6a7e-4953-b25a-4a877463f0b5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:19.143095 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8ff499be-6a7e-4953-b25a-4a877463f0b5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:19.143670 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8ff499be-6a7e-4953-b25a-4a877463f0b5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:19.144820 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8ff499be-6a7e-4953-b25a-4a877463f0b5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:19.145668 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8ff499be-6a7e-4953-b25a-4a877463f0b5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:19.146185 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8ff499be-6a7e-4953-b25a-4a877463f0b5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:19.146636 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8ff499be-6a7e-4953-b25a-4a877463f0b5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:19.290496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8ff499be-6a7e-4953-b25a-4a877463f0b5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:19.303191 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8ff499be-6a7e-4953-b25a-4a877463f0b5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:19.304677 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8ff499be-6a7e-4953-b25a-4a877463f0b5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:19.305861 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8ff499be-6a7e-4953-b25a-4a877463f0b5 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.179190 Aug 29 20:37:19.306418 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 286/554] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:19 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:37:19.611175 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a10550d0-a868-43a2-97c1-99486512c196 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:19.611790 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a10550d0-a868-43a2-97c1-99486512c196 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:19.618490 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a10550d0-a868-43a2-97c1-99486512c196 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:19.618969 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a10550d0-a868-43a2-97c1-99486512c196 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:19.619403 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a10550d0-a868-43a2-97c1-99486512c196 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:19.620138 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a10550d0-a868-43a2-97c1-99486512c196 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:19.620594 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a10550d0-a868-43a2-97c1-99486512c196 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:19.621622 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a10550d0-a868-43a2-97c1-99486512c196 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:19.771653 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a10550d0-a868-43a2-97c1-99486512c196 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:19.780073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a10550d0-a868-43a2-97c1-99486512c196 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1751 microversion: 2.1 time: 0.172896 Aug 29 20:37:19.780643 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 269/555] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:19 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:20.330170 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d411df6a-f19a-4a94-870c-066cd8b18959 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:20.330625 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d411df6a-f19a-4a94-870c-066cd8b18959 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:20.337139 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d411df6a-f19a-4a94-870c-066cd8b18959 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:20.337580 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d411df6a-f19a-4a94-870c-066cd8b18959 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:20.337898 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d411df6a-f19a-4a94-870c-066cd8b18959 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:20.338598 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d411df6a-f19a-4a94-870c-066cd8b18959 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:20.339046 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d411df6a-f19a-4a94-870c-066cd8b18959 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:20.339501 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d411df6a-f19a-4a94-870c-066cd8b18959 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:20.478744 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d411df6a-f19a-4a94-870c-066cd8b18959 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:20.488061 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d411df6a-f19a-4a94-870c-066cd8b18959 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:20.489495 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d411df6a-f19a-4a94-870c-066cd8b18959 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:20.490662 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d411df6a-f19a-4a94-870c-066cd8b18959 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.164651 Aug 29 20:37:20.491216 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 287/556] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:20 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:20.802426 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6736f597-fc73-421d-baed-d19eedc8b664 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:20.803034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6736f597-fc73-421d-baed-d19eedc8b664 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:20.810601 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6736f597-fc73-421d-baed-d19eedc8b664 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:20.810601 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6736f597-fc73-421d-baed-d19eedc8b664 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:20.811459 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6736f597-fc73-421d-baed-d19eedc8b664 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:20.812200 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6736f597-fc73-421d-baed-d19eedc8b664 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:20.812654 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6736f597-fc73-421d-baed-d19eedc8b664 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:20.813075 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6736f597-fc73-421d-baed-d19eedc8b664 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:21.076705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6736f597-fc73-421d-baed-d19eedc8b664 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:21.086867 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6736f597-fc73-421d-baed-d19eedc8b664 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1751 microversion: 2.1 time: 0.288235 Aug 29 20:37:21.087596 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 270/557] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:20 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1751 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:21.486482 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-977253af-9bd2-4c41-acc4-68e63e308c67 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:21.488999 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-977253af-9bd2-4c41-acc4-68e63e308c67 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:21.497312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-977253af-9bd2-4c41-acc4-68e63e308c67 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:21.497843 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-977253af-9bd2-4c41-acc4-68e63e308c67 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:21.498283 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-977253af-9bd2-4c41-acc4-68e63e308c67 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:21.498984 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-977253af-9bd2-4c41-acc4-68e63e308c67 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:21.500092 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-977253af-9bd2-4c41-acc4-68e63e308c67 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:21.500513 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-977253af-9bd2-4c41-acc4-68e63e308c67 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:21.515449 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-67e93634-8c9d-4a0e-8645-2c256efe9665 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:21.516095 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-67e93634-8c9d-4a0e-8645-2c256efe9665 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:21.524001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67e93634-8c9d-4a0e-8645-2c256efe9665 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:21.524001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67e93634-8c9d-4a0e-8645-2c256efe9665 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:21.524346 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67e93634-8c9d-4a0e-8645-2c256efe9665 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:21.524974 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67e93634-8c9d-4a0e-8645-2c256efe9665 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:21.525652 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67e93634-8c9d-4a0e-8645-2c256efe9665 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:21.526070 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-67e93634-8c9d-4a0e-8645-2c256efe9665 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:21.529640 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-977253af-9bd2-4c41-acc4-68e63e308c67 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lazy-loading 'flavor' on Instance uuid 64544993-4d2e-4125-9371-c55b598a4ab1 {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:37:21.674730 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-67e93634-8c9d-4a0e-8645-2c256efe9665 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:21.679550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-977253af-9bd2-4c41-acc4-68e63e308c67 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "POST /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/action" status: 200 len: 32 microversion: 2.1 time: 0.197514 Aug 29 20:37:21.680309 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 288/558] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 29 20:37:21 2022] POST /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:37:21.683952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-67e93634-8c9d-4a0e-8645-2c256efe9665 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:21.686431 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-67e93634-8c9d-4a0e-8645-2c256efe9665 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:21.688314 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-67e93634-8c9d-4a0e-8645-2c256efe9665 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.177264 Aug 29 20:37:21.691438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 271/559] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:21 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:37:21.698926 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7f40e654-7915-4632-b786-7d2aa9891c43 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:21.700394 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7f40e654-7915-4632-b786-7d2aa9891c43 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:21.711296 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7f40e654-7915-4632-b786-7d2aa9891c43 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:21.711789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7f40e654-7915-4632-b786-7d2aa9891c43 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:21.712287 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7f40e654-7915-4632-b786-7d2aa9891c43 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:21.712998 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7f40e654-7915-4632-b786-7d2aa9891c43 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:21.713449 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7f40e654-7915-4632-b786-7d2aa9891c43 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:21.713872 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7f40e654-7915-4632-b786-7d2aa9891c43 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:21.869959 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7f40e654-7915-4632-b786-7d2aa9891c43 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:21.886798 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7f40e654-7915-4632-b786-7d2aa9891c43 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.197348 Aug 29 20:37:21.887720 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 289/560] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:21 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:37:22.108107 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1abb34cd-3198-49f8-bbc5-9759caef5b85 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:22.108937 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1abb34cd-3198-49f8-bbc5-9759caef5b85 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:22.115390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1abb34cd-3198-49f8-bbc5-9759caef5b85 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:22.115874 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1abb34cd-3198-49f8-bbc5-9759caef5b85 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:22.116347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1abb34cd-3198-49f8-bbc5-9759caef5b85 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:22.117112 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1abb34cd-3198-49f8-bbc5-9759caef5b85 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:22.117509 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1abb34cd-3198-49f8-bbc5-9759caef5b85 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:22.117933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1abb34cd-3198-49f8-bbc5-9759caef5b85 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:22.369055 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1abb34cd-3198-49f8-bbc5-9759caef5b85 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:22.379315 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1abb34cd-3198-49f8-bbc5-9759caef5b85 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1756 microversion: 2.1 time: 0.274439 Aug 29 20:37:22.387970 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 272/561] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:22 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1756 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:22.711675 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-159ce9bd-efc9-4450-b39e-e260e01d19de tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:22.712403 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-159ce9bd-efc9-4450-b39e-e260e01d19de tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:22.720507 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-159ce9bd-efc9-4450-b39e-e260e01d19de tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:22.721000 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-159ce9bd-efc9-4450-b39e-e260e01d19de tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:22.721432 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-159ce9bd-efc9-4450-b39e-e260e01d19de tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:22.722187 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-159ce9bd-efc9-4450-b39e-e260e01d19de tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:22.722637 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-159ce9bd-efc9-4450-b39e-e260e01d19de tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:22.723084 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-159ce9bd-efc9-4450-b39e-e260e01d19de tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:22.898265 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-159ce9bd-efc9-4450-b39e-e260e01d19de tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:22.909413 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-159ce9bd-efc9-4450-b39e-e260e01d19de tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:22.909803 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2ceb8f4b-e6b1-4617-a0a0-967e2feeaf06 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:22.910427 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2ceb8f4b-e6b1-4617-a0a0-967e2feeaf06 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:22.911094 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-159ce9bd-efc9-4450-b39e-e260e01d19de tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:22.912630 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-159ce9bd-efc9-4450-b39e-e260e01d19de tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.204852 Aug 29 20:37:22.916222 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 290/562] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:22 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:22.917629 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ceb8f4b-e6b1-4617-a0a0-967e2feeaf06 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:22.918129 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ceb8f4b-e6b1-4617-a0a0-967e2feeaf06 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:22.919248 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ceb8f4b-e6b1-4617-a0a0-967e2feeaf06 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:22.920135 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ceb8f4b-e6b1-4617-a0a0-967e2feeaf06 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:22.920625 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ceb8f4b-e6b1-4617-a0a0-967e2feeaf06 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:22.921060 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2ceb8f4b-e6b1-4617-a0a0-967e2feeaf06 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:23.078406 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-2ceb8f4b-e6b1-4617-a0a0-967e2feeaf06 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:23.087152 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2ceb8f4b-e6b1-4617-a0a0-967e2feeaf06 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.181374 Aug 29 20:37:23.087734 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 273/563] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:22 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:23.402435 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8e3ecada-97bf-45e6-a916-e5c861169945 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:23.403039 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8e3ecada-97bf-45e6-a916-e5c861169945 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:23.409316 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e3ecada-97bf-45e6-a916-e5c861169945 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:23.409786 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e3ecada-97bf-45e6-a916-e5c861169945 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:23.410217 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e3ecada-97bf-45e6-a916-e5c861169945 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:23.410898 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e3ecada-97bf-45e6-a916-e5c861169945 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:23.411341 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e3ecada-97bf-45e6-a916-e5c861169945 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:23.411755 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e3ecada-97bf-45e6-a916-e5c861169945 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:23.574452 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8e3ecada-97bf-45e6-a916-e5c861169945 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:23.583690 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8e3ecada-97bf-45e6-a916-e5c861169945 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1756 microversion: 2.1 time: 0.185048 Aug 29 20:37:23.584325 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 291/564] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:23 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:23.937644 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fd7f7271-1019-4042-a911-a0c68bdad955 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:23.938194 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fd7f7271-1019-4042-a911-a0c68bdad955 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:23.944767 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd7f7271-1019-4042-a911-a0c68bdad955 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:23.945304 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd7f7271-1019-4042-a911-a0c68bdad955 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:23.945694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd7f7271-1019-4042-a911-a0c68bdad955 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:23.946381 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd7f7271-1019-4042-a911-a0c68bdad955 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:23.946831 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd7f7271-1019-4042-a911-a0c68bdad955 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:23.947243 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd7f7271-1019-4042-a911-a0c68bdad955 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:24.083251 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd7f7271-1019-4042-a911-a0c68bdad955 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:24.092449 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd7f7271-1019-4042-a911-a0c68bdad955 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:24.093886 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd7f7271-1019-4042-a911-a0c68bdad955 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:24.095042 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fd7f7271-1019-4042-a911-a0c68bdad955 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.161698 Aug 29 20:37:24.095600 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 274/565] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:23 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:24.110017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-0e4fecb1-b74a-48a9-9e51-7e16b7f3513e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:24.110779 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-0e4fecb1-b74a-48a9-9e51-7e16b7f3513e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:24.117980 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0e4fecb1-b74a-48a9-9e51-7e16b7f3513e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:24.118462 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0e4fecb1-b74a-48a9-9e51-7e16b7f3513e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:24.118902 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0e4fecb1-b74a-48a9-9e51-7e16b7f3513e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:24.119600 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0e4fecb1-b74a-48a9-9e51-7e16b7f3513e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:24.120081 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0e4fecb1-b74a-48a9-9e51-7e16b7f3513e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:24.120505 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0e4fecb1-b74a-48a9-9e51-7e16b7f3513e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:24.254338 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-0e4fecb1-b74a-48a9-9e51-7e16b7f3513e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:24.262992 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-0e4fecb1-b74a-48a9-9e51-7e16b7f3513e tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.158898 Aug 29 20:37:24.263551 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 292/566] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:24 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:37:24.606755 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-99d4484e-30af-4063-8914-36c95eace555 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:24.607371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-99d4484e-30af-4063-8914-36c95eace555 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:24.613615 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-99d4484e-30af-4063-8914-36c95eace555 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:24.614097 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-99d4484e-30af-4063-8914-36c95eace555 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:24.614532 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-99d4484e-30af-4063-8914-36c95eace555 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:24.615230 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-99d4484e-30af-4063-8914-36c95eace555 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:24.615684 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-99d4484e-30af-4063-8914-36c95eace555 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:24.616143 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-99d4484e-30af-4063-8914-36c95eace555 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:24.755544 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-99d4484e-30af-4063-8914-36c95eace555 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:24.764454 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-99d4484e-30af-4063-8914-36c95eace555 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1756 microversion: 2.1 time: 0.162455 Aug 29 20:37:24.765015 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 275/567] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:24 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:24.945433 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-6838d476-636a-4d62-a4e2-571a7026ccb3 req-4e1a5469-f9c3-4e44-b8cf-cca1cdb097da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95026449-87b2-4f37-bfd3-554df7e6a037", "name": "network-vif-plugged", "status": "completed", "tag": "87154a2a-cc60-4d5c-bce5-20690a774470"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:24.956466 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-6838d476-636a-4d62-a4e2-571a7026ccb3 req-4e1a5469-f9c3-4e44-b8cf-cca1cdb097da service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:24.957692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-6838d476-636a-4d62-a4e2-571a7026ccb3 req-4e1a5469-f9c3-4e44-b8cf-cca1cdb097da service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:24.958122 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-6838d476-636a-4d62-a4e2-571a7026ccb3 req-4e1a5469-f9c3-4e44-b8cf-cca1cdb097da service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:24.971397 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-6838d476-636a-4d62-a4e2-571a7026ccb3 req-4e1a5469-f9c3-4e44-b8cf-cca1cdb097da service nova] Creating event network-vif-plugged:87154a2a-cc60-4d5c-bce5-20690a774470 for instance 95026449-87b2-4f37-bfd3-554df7e6a037 on hv-cinder-85426 Aug 29 20:37:24.976785 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-6838d476-636a-4d62-a4e2-571a7026ccb3 req-4e1a5469-f9c3-4e44-b8cf-cca1cdb097da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035728 Aug 29 20:37:24.977828 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 293/568] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:37:25.117454 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-47b2714b-d85a-45fc-a256-cf0e33042afb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:25.118067 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-47b2714b-d85a-45fc-a256-cf0e33042afb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:25.120415 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:25.125816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47b2714b-d85a-45fc-a256-cf0e33042afb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:25.126303 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47b2714b-d85a-45fc-a256-cf0e33042afb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:25.126732 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47b2714b-d85a-45fc-a256-cf0e33042afb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:25.127423 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47b2714b-d85a-45fc-a256-cf0e33042afb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:25.127871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47b2714b-d85a-45fc-a256-cf0e33042afb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:25.128314 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-47b2714b-d85a-45fc-a256-cf0e33042afb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:25.268528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-47b2714b-d85a-45fc-a256-cf0e33042afb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:25.282623 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-47b2714b-d85a-45fc-a256-cf0e33042afb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:25.285120 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-47b2714b-d85a-45fc-a256-cf0e33042afb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:25.285597 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-49ab4f0f-d196-4e8b-a8ae-c945a5d311ad tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:25.286307 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-49ab4f0f-d196-4e8b-a8ae-c945a5d311ad tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:25.288238 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-47b2714b-d85a-45fc-a256-cf0e33042afb tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.174366 Aug 29 20:37:25.293094 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-49ab4f0f-d196-4e8b-a8ae-c945a5d311ad tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:25.293832 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-49ab4f0f-d196-4e8b-a8ae-c945a5d311ad tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:25.294272 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-49ab4f0f-d196-4e8b-a8ae-c945a5d311ad tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:25.294983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-49ab4f0f-d196-4e8b-a8ae-c945a5d311ad tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:25.295438 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-49ab4f0f-d196-4e8b-a8ae-c945a5d311ad tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:25.295864 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-49ab4f0f-d196-4e8b-a8ae-c945a5d311ad tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:25.298116 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 276/569] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:25 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:25.437018 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-49ab4f0f-d196-4e8b-a8ae-c945a5d311ad tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:25.446078 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-49ab4f0f-d196-4e8b-a8ae-c945a5d311ad tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.165759 Aug 29 20:37:25.446667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 294/570] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:25 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:37:25.786804 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c9fc9e59-0eb4-4daf-929a-08f4b119dd63 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:25.787414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c9fc9e59-0eb4-4daf-929a-08f4b119dd63 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:25.793898 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9fc9e59-0eb4-4daf-929a-08f4b119dd63 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:25.794377 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9fc9e59-0eb4-4daf-929a-08f4b119dd63 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:25.794873 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9fc9e59-0eb4-4daf-929a-08f4b119dd63 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:25.795488 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9fc9e59-0eb4-4daf-929a-08f4b119dd63 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:25.795954 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9fc9e59-0eb4-4daf-929a-08f4b119dd63 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:25.796385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c9fc9e59-0eb4-4daf-929a-08f4b119dd63 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:25.942574 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c9fc9e59-0eb4-4daf-929a-08f4b119dd63 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:25.951344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c9fc9e59-0eb4-4daf-929a-08f4b119dd63 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1756 microversion: 2.1 time: 0.168515 Aug 29 20:37:25.951899 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 277/571] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:25 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:26.319292 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-46aa5902-60fe-4792-abcd-a83e291939ee tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:26.319906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-46aa5902-60fe-4792-abcd-a83e291939ee tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:26.327423 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-46aa5902-60fe-4792-abcd-a83e291939ee tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:26.327910 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-46aa5902-60fe-4792-abcd-a83e291939ee tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:26.328379 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-46aa5902-60fe-4792-abcd-a83e291939ee tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:26.329142 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-46aa5902-60fe-4792-abcd-a83e291939ee tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:26.329697 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-46aa5902-60fe-4792-abcd-a83e291939ee tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:26.330066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-46aa5902-60fe-4792-abcd-a83e291939ee tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:26.468424 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-756fa8d6-a3d3-480b-b2e2-dc0dd83f6181 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:26.469034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-756fa8d6-a3d3-480b-b2e2-dc0dd83f6181 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:26.476200 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-756fa8d6-a3d3-480b-b2e2-dc0dd83f6181 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:26.476378 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-46aa5902-60fe-4792-abcd-a83e291939ee tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:26.476695 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-756fa8d6-a3d3-480b-b2e2-dc0dd83f6181 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:26.477185 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-756fa8d6-a3d3-480b-b2e2-dc0dd83f6181 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:26.477948 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-756fa8d6-a3d3-480b-b2e2-dc0dd83f6181 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:26.478469 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-756fa8d6-a3d3-480b-b2e2-dc0dd83f6181 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:26.480696 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-756fa8d6-a3d3-480b-b2e2-dc0dd83f6181 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:26.490054 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-46aa5902-60fe-4792-abcd-a83e291939ee tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:26.491502 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-46aa5902-60fe-4792-abcd-a83e291939ee tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:26.492729 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-46aa5902-60fe-4792-abcd-a83e291939ee tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.177380 Aug 29 20:37:26.493296 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 295/572] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:26 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:26.614583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-756fa8d6-a3d3-480b-b2e2-dc0dd83f6181 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:26.623604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-756fa8d6-a3d3-480b-b2e2-dc0dd83f6181 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.159781 Aug 29 20:37:26.624216 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 278/573] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:26 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:37:26.979756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2f27e5c0-1b65-4154-a88d-03d0d7124c3a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:26.981685 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2f27e5c0-1b65-4154-a88d-03d0d7124c3a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:26.991803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f27e5c0-1b65-4154-a88d-03d0d7124c3a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:26.992428 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f27e5c0-1b65-4154-a88d-03d0d7124c3a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:26.992959 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f27e5c0-1b65-4154-a88d-03d0d7124c3a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:26.993751 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f27e5c0-1b65-4154-a88d-03d0d7124c3a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:26.994332 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f27e5c0-1b65-4154-a88d-03d0d7124c3a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:26.994854 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2f27e5c0-1b65-4154-a88d-03d0d7124c3a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:27.139692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2f27e5c0-1b65-4154-a88d-03d0d7124c3a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:27.148161 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2f27e5c0-1b65-4154-a88d-03d0d7124c3a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1756 microversion: 2.1 time: 0.176081 Aug 29 20:37:27.148759 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 296/574] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:26 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:27.516126 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f6585d27-5ebe-4a0f-8636-9614b2591c13 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:27.516738 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f6585d27-5ebe-4a0f-8636-9614b2591c13 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:27.523856 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6585d27-5ebe-4a0f-8636-9614b2591c13 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:27.524383 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6585d27-5ebe-4a0f-8636-9614b2591c13 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:27.525000 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6585d27-5ebe-4a0f-8636-9614b2591c13 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:27.525711 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6585d27-5ebe-4a0f-8636-9614b2591c13 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:27.526166 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6585d27-5ebe-4a0f-8636-9614b2591c13 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:27.526587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6585d27-5ebe-4a0f-8636-9614b2591c13 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:27.645516 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-bd628cb5-c572-43d6-95bc-5f33bafe25ca tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:27.646136 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-bd628cb5-c572-43d6-95bc-5f33bafe25ca tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:27.653639 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bd628cb5-c572-43d6-95bc-5f33bafe25ca tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:27.654024 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bd628cb5-c572-43d6-95bc-5f33bafe25ca tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:27.654420 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bd628cb5-c572-43d6-95bc-5f33bafe25ca tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:27.655403 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bd628cb5-c572-43d6-95bc-5f33bafe25ca tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:27.655863 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bd628cb5-c572-43d6-95bc-5f33bafe25ca tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:27.656461 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bd628cb5-c572-43d6-95bc-5f33bafe25ca tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:27.681166 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6585d27-5ebe-4a0f-8636-9614b2591c13 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:27.690930 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6585d27-5ebe-4a0f-8636-9614b2591c13 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:27.692405 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f6585d27-5ebe-4a0f-8636-9614b2591c13 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:27.693575 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f6585d27-5ebe-4a0f-8636-9614b2591c13 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1806 microversion: 2.20 time: 0.181506 Aug 29 20:37:27.696261 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 279/575] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:27 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:27.807901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-bd628cb5-c572-43d6-95bc-5f33bafe25ca tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:27.817030 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-bd628cb5-c572-43d6-95bc-5f33bafe25ca tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.176168 Aug 29 20:37:27.817604 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 297/576] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:27 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:37:28.171083 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8e921327-84bf-4f18-8aa3-9ab8a53bfac0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:28.171730 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8e921327-84bf-4f18-8aa3-9ab8a53bfac0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:28.177767 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e921327-84bf-4f18-8aa3-9ab8a53bfac0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:28.178301 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e921327-84bf-4f18-8aa3-9ab8a53bfac0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:28.178728 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e921327-84bf-4f18-8aa3-9ab8a53bfac0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:28.179421 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e921327-84bf-4f18-8aa3-9ab8a53bfac0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:28.179869 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e921327-84bf-4f18-8aa3-9ab8a53bfac0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:28.180343 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8e921327-84bf-4f18-8aa3-9ab8a53bfac0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:28.335526 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8e921327-84bf-4f18-8aa3-9ab8a53bfac0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:28.343813 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8e921327-84bf-4f18-8aa3-9ab8a53bfac0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1756 microversion: 2.1 time: 0.177019 Aug 29 20:37:28.344418 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 280/577] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:28 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:28.717892 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f3ff31fb-3ee9-4b0c-a352-bfd98be6cacd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:28.718418 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-f3ff31fb-3ee9-4b0c-a352-bfd98be6cacd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:28.724968 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f3ff31fb-3ee9-4b0c-a352-bfd98be6cacd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:28.725448 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f3ff31fb-3ee9-4b0c-a352-bfd98be6cacd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:28.725878 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f3ff31fb-3ee9-4b0c-a352-bfd98be6cacd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:28.726578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f3ff31fb-3ee9-4b0c-a352-bfd98be6cacd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:28.727030 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f3ff31fb-3ee9-4b0c-a352-bfd98be6cacd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:28.727452 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f3ff31fb-3ee9-4b0c-a352-bfd98be6cacd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:28.838623 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-00287762-f0ab-4f54-8f54-d30d36b73762 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:28.839894 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-00287762-f0ab-4f54-8f54-d30d36b73762 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:28.846717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00287762-f0ab-4f54-8f54-d30d36b73762 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:28.847293 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00287762-f0ab-4f54-8f54-d30d36b73762 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:28.847800 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00287762-f0ab-4f54-8f54-d30d36b73762 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:28.848598 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00287762-f0ab-4f54-8f54-d30d36b73762 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:28.849130 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00287762-f0ab-4f54-8f54-d30d36b73762 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:28.849630 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-00287762-f0ab-4f54-8f54-d30d36b73762 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:28.860774 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-f3ff31fb-3ee9-4b0c-a352-bfd98be6cacd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:28.870055 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-f3ff31fb-3ee9-4b0c-a352-bfd98be6cacd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:28.875665 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-f3ff31fb-3ee9-4b0c-a352-bfd98be6cacd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:28.876911 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-f3ff31fb-3ee9-4b0c-a352-bfd98be6cacd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1793 microversion: 2.20 time: 0.163603 Aug 29 20:37:28.877483 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 298/578] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:37:28 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1793 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:37:28.995640 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-00287762-f0ab-4f54-8f54-d30d36b73762 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:29.004365 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-00287762-f0ab-4f54-8f54-d30d36b73762 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.169610 Aug 29 20:37:29.004929 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 281/579] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:28 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:37:29.365536 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7dd39dd6-48be-409f-aa77-dec7c4e16ea6 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:29.366151 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7dd39dd6-48be-409f-aa77-dec7c4e16ea6 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:29.372393 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7dd39dd6-48be-409f-aa77-dec7c4e16ea6 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:29.372885 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7dd39dd6-48be-409f-aa77-dec7c4e16ea6 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:29.373320 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7dd39dd6-48be-409f-aa77-dec7c4e16ea6 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:29.374028 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7dd39dd6-48be-409f-aa77-dec7c4e16ea6 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:29.374487 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7dd39dd6-48be-409f-aa77-dec7c4e16ea6 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:29.374914 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7dd39dd6-48be-409f-aa77-dec7c4e16ea6 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:29.522155 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7dd39dd6-48be-409f-aa77-dec7c4e16ea6 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:29.530957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7dd39dd6-48be-409f-aa77-dec7c4e16ea6 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1756 microversion: 2.1 time: 0.169319 Aug 29 20:37:29.531550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 299/580] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:29 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:30.027447 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0adac8fc-a2e9-4013-b27f-e075654a4b96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:30.028106 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0adac8fc-a2e9-4013-b27f-e075654a4b96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:30.034903 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0adac8fc-a2e9-4013-b27f-e075654a4b96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:30.035391 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0adac8fc-a2e9-4013-b27f-e075654a4b96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:30.035865 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0adac8fc-a2e9-4013-b27f-e075654a4b96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:30.036637 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0adac8fc-a2e9-4013-b27f-e075654a4b96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:30.037097 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0adac8fc-a2e9-4013-b27f-e075654a4b96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:30.037533 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0adac8fc-a2e9-4013-b27f-e075654a4b96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:30.173970 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0adac8fc-a2e9-4013-b27f-e075654a4b96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:30.183236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0adac8fc-a2e9-4013-b27f-e075654a4b96 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.160158 Aug 29 20:37:30.183813 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 282/581] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:30 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:30.551725 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d2b11c81-ae5d-4b2c-a9ab-dc2e44444762 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:30.552348 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d2b11c81-ae5d-4b2c-a9ab-dc2e44444762 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:30.559632 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d2b11c81-ae5d-4b2c-a9ab-dc2e44444762 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:30.560081 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d2b11c81-ae5d-4b2c-a9ab-dc2e44444762 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:30.560762 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d2b11c81-ae5d-4b2c-a9ab-dc2e44444762 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:30.561477 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d2b11c81-ae5d-4b2c-a9ab-dc2e44444762 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:30.562013 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d2b11c81-ae5d-4b2c-a9ab-dc2e44444762 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:30.562442 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d2b11c81-ae5d-4b2c-a9ab-dc2e44444762 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:30.566629 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:30.709857 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d2b11c81-ae5d-4b2c-a9ab-dc2e44444762 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:30.718213 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d2b11c81-ae5d-4b2c-a9ab-dc2e44444762 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1756 microversion: 2.1 time: 0.170261 Aug 29 20:37:30.718775 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 300/582] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:30 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:31.204767 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-af75fc2c-c795-4d05-8d4d-1431ffdde085 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:31.205377 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-af75fc2c-c795-4d05-8d4d-1431ffdde085 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:31.211550 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af75fc2c-c795-4d05-8d4d-1431ffdde085 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:31.212058 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af75fc2c-c795-4d05-8d4d-1431ffdde085 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:31.212491 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af75fc2c-c795-4d05-8d4d-1431ffdde085 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:31.213182 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af75fc2c-c795-4d05-8d4d-1431ffdde085 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:31.213639 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af75fc2c-c795-4d05-8d4d-1431ffdde085 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:31.214059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-af75fc2c-c795-4d05-8d4d-1431ffdde085 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:31.218002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:31.358480 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-af75fc2c-c795-4d05-8d4d-1431ffdde085 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:31.370484 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-af75fc2c-c795-4d05-8d4d-1431ffdde085 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.169460 Aug 29 20:37:31.371076 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 283/583] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:31 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:37:31.740179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7c808603-0716-4bad-a6bd-723ea4ece197 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:31.740788 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7c808603-0716-4bad-a6bd-723ea4ece197 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:31.747373 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7c808603-0716-4bad-a6bd-723ea4ece197 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:31.747844 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7c808603-0716-4bad-a6bd-723ea4ece197 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:31.748306 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7c808603-0716-4bad-a6bd-723ea4ece197 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:31.748995 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7c808603-0716-4bad-a6bd-723ea4ece197 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:31.749449 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7c808603-0716-4bad-a6bd-723ea4ece197 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:31.749857 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7c808603-0716-4bad-a6bd-723ea4ece197 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:31.900032 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7c808603-0716-4bad-a6bd-723ea4ece197 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:31.908925 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7c808603-0716-4bad-a6bd-723ea4ece197 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1756 microversion: 2.1 time: 0.172642 Aug 29 20:37:31.909560 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 301/584] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:31 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:32.390701 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-91a55ee7-42d9-4b02-bb56-744f3757fee6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:32.391346 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-91a55ee7-42d9-4b02-bb56-744f3757fee6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:32.397944 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91a55ee7-42d9-4b02-bb56-744f3757fee6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:32.398431 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91a55ee7-42d9-4b02-bb56-744f3757fee6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:32.398865 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91a55ee7-42d9-4b02-bb56-744f3757fee6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:32.399561 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91a55ee7-42d9-4b02-bb56-744f3757fee6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:32.400041 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91a55ee7-42d9-4b02-bb56-744f3757fee6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:32.400607 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91a55ee7-42d9-4b02-bb56-744f3757fee6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:32.544953 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-91a55ee7-42d9-4b02-bb56-744f3757fee6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:32.553318 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-91a55ee7-42d9-4b02-bb56-744f3757fee6 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.166451 Aug 29 20:37:32.554003 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 284/585] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:32 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:32.931997 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e7d469fd-990c-4b28-bb0a-e3c81e4e0bcf tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:32.932648 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e7d469fd-990c-4b28-bb0a-e3c81e4e0bcf tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:32.940383 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e7d469fd-990c-4b28-bb0a-e3c81e4e0bcf tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:32.940877 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e7d469fd-990c-4b28-bb0a-e3c81e4e0bcf tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:32.941312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e7d469fd-990c-4b28-bb0a-e3c81e4e0bcf tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:32.942018 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e7d469fd-990c-4b28-bb0a-e3c81e4e0bcf tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:32.942499 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e7d469fd-990c-4b28-bb0a-e3c81e4e0bcf tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:32.942926 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e7d469fd-990c-4b28-bb0a-e3c81e4e0bcf tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:33.116175 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e7d469fd-990c-4b28-bb0a-e3c81e4e0bcf tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:33.125012 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e7d469fd-990c-4b28-bb0a-e3c81e4e0bcf tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1756 microversion: 2.1 time: 0.197003 Aug 29 20:37:33.125575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 302/586] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:32 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:33.575683 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e274e1b3-8a3c-45e3-b615-6957b4ac2d87 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:33.576409 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e274e1b3-8a3c-45e3-b615-6957b4ac2d87 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:33.582783 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e274e1b3-8a3c-45e3-b615-6957b4ac2d87 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:33.583248 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e274e1b3-8a3c-45e3-b615-6957b4ac2d87 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:33.583677 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e274e1b3-8a3c-45e3-b615-6957b4ac2d87 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:33.584405 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e274e1b3-8a3c-45e3-b615-6957b4ac2d87 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:33.584863 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e274e1b3-8a3c-45e3-b615-6957b4ac2d87 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:33.585279 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e274e1b3-8a3c-45e3-b615-6957b4ac2d87 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:33.731766 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e274e1b3-8a3c-45e3-b615-6957b4ac2d87 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:33.742910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e274e1b3-8a3c-45e3-b615-6957b4ac2d87 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.171234 Aug 29 20:37:33.743490 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 285/587] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:33 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:37:34.148201 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ae195d14-1bef-45e2-a781-c3b57bbb285f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:34.148838 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ae195d14-1bef-45e2-a781-c3b57bbb285f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:34.155520 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ae195d14-1bef-45e2-a781-c3b57bbb285f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:34.156027 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ae195d14-1bef-45e2-a781-c3b57bbb285f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:34.156455 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ae195d14-1bef-45e2-a781-c3b57bbb285f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:34.157154 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ae195d14-1bef-45e2-a781-c3b57bbb285f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:34.157624 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ae195d14-1bef-45e2-a781-c3b57bbb285f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:34.158039 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ae195d14-1bef-45e2-a781-c3b57bbb285f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:34.312647 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-ae195d14-1bef-45e2-a781-c3b57bbb285f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:34.321512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ae195d14-1bef-45e2-a781-c3b57bbb285f tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1756 microversion: 2.1 time: 0.178014 Aug 29 20:37:34.322079 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 303/588] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:34 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:34.764776 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-653df1f6-40e4-4991-a516-b6f757b5db6c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:34.765413 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-653df1f6-40e4-4991-a516-b6f757b5db6c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:34.772097 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653df1f6-40e4-4991-a516-b6f757b5db6c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:34.772588 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653df1f6-40e4-4991-a516-b6f757b5db6c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:34.773025 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653df1f6-40e4-4991-a516-b6f757b5db6c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:34.773726 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653df1f6-40e4-4991-a516-b6f757b5db6c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:34.774182 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653df1f6-40e4-4991-a516-b6f757b5db6c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:34.774611 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-653df1f6-40e4-4991-a516-b6f757b5db6c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:34.909342 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-653df1f6-40e4-4991-a516-b6f757b5db6c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:34.918403 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-653df1f6-40e4-4991-a516-b6f757b5db6c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.157498 Aug 29 20:37:34.918968 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 286/589] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:34 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:35.346712 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-23bf3902-bf98-4762-b1ea-f8b628355886 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:35.347363 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-23bf3902-bf98-4762-b1ea-f8b628355886 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:35.349747 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=54 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:35.355422 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-23bf3902-bf98-4762-b1ea-f8b628355886 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:35.355914 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-23bf3902-bf98-4762-b1ea-f8b628355886 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:35.356391 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-23bf3902-bf98-4762-b1ea-f8b628355886 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:35.357076 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-23bf3902-bf98-4762-b1ea-f8b628355886 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:35.357530 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-23bf3902-bf98-4762-b1ea-f8b628355886 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:35.358050 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-23bf3902-bf98-4762-b1ea-f8b628355886 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:35.505914 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-23bf3902-bf98-4762-b1ea-f8b628355886 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:35.514429 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-23bf3902-bf98-4762-b1ea-f8b628355886 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1756 microversion: 2.1 time: 0.171672 Aug 29 20:37:35.514998 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 304/590] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:35 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:35.940002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4d9cc9e5-68bc-487f-8460-f98e5f540e34 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:35.940621 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4d9cc9e5-68bc-487f-8460-f98e5f540e34 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:35.947047 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d9cc9e5-68bc-487f-8460-f98e5f540e34 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:35.947531 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d9cc9e5-68bc-487f-8460-f98e5f540e34 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:35.947992 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d9cc9e5-68bc-487f-8460-f98e5f540e34 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:35.949204 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d9cc9e5-68bc-487f-8460-f98e5f540e34 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:35.949677 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d9cc9e5-68bc-487f-8460-f98e5f540e34 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:35.950101 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4d9cc9e5-68bc-487f-8460-f98e5f540e34 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:36.315130 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-4d9cc9e5-68bc-487f-8460-f98e5f540e34 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:36.324596 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4d9cc9e5-68bc-487f-8460-f98e5f540e34 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.388104 Aug 29 20:37:36.325162 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 287/591] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:35 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:36.536887 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-83b4eb88-f3ae-4ec0-a0c7-c14d729351f0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:36.537569 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-83b4eb88-f3ae-4ec0-a0c7-c14d729351f0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:36.544840 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-83b4eb88-f3ae-4ec0-a0c7-c14d729351f0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:36.545325 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-83b4eb88-f3ae-4ec0-a0c7-c14d729351f0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:36.545764 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-83b4eb88-f3ae-4ec0-a0c7-c14d729351f0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:36.546458 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-83b4eb88-f3ae-4ec0-a0c7-c14d729351f0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:36.546942 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-83b4eb88-f3ae-4ec0-a0c7-c14d729351f0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:36.547366 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-83b4eb88-f3ae-4ec0-a0c7-c14d729351f0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:36.690049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-83b4eb88-f3ae-4ec0-a0c7-c14d729351f0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:36.698167 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-83b4eb88-f3ae-4ec0-a0c7-c14d729351f0 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1756 microversion: 2.1 time: 0.165170 Aug 29 20:37:36.698727 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 305/592] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:36 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:37.345992 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-507449fa-ec87-4a9a-a50d-f97baf239407 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:37.346636 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-507449fa-ec87-4a9a-a50d-f97baf239407 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:37.353268 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-507449fa-ec87-4a9a-a50d-f97baf239407 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:37.353749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-507449fa-ec87-4a9a-a50d-f97baf239407 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:37.354184 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-507449fa-ec87-4a9a-a50d-f97baf239407 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:37.355394 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-507449fa-ec87-4a9a-a50d-f97baf239407 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:37.355846 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-507449fa-ec87-4a9a-a50d-f97baf239407 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:37.356297 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-507449fa-ec87-4a9a-a50d-f97baf239407 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:37.486869 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-507449fa-ec87-4a9a-a50d-f97baf239407 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:37.495035 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-507449fa-ec87-4a9a-a50d-f97baf239407 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.153054 Aug 29 20:37:37.496206 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 288/593] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:37 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:37.719217 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4271f335-2a1e-4a2c-ac84-209e2cac5ff8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:37.719823 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4271f335-2a1e-4a2c-ac84-209e2cac5ff8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:37.726443 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4271f335-2a1e-4a2c-ac84-209e2cac5ff8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:37.726921 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4271f335-2a1e-4a2c-ac84-209e2cac5ff8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:37.727381 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4271f335-2a1e-4a2c-ac84-209e2cac5ff8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:37.728104 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4271f335-2a1e-4a2c-ac84-209e2cac5ff8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:37.728551 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4271f335-2a1e-4a2c-ac84-209e2cac5ff8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:37.728969 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4271f335-2a1e-4a2c-ac84-209e2cac5ff8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:37.883141 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4271f335-2a1e-4a2c-ac84-209e2cac5ff8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:37.892618 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4271f335-2a1e-4a2c-ac84-209e2cac5ff8 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1756 microversion: 2.1 time: 0.177229 Aug 29 20:37:37.893179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 306/594] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:37 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:38.518521 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a4c22b88-38a2-4f8c-8c53-58a5e28affab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:38.519123 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a4c22b88-38a2-4f8c-8c53-58a5e28affab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:38.525695 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4c22b88-38a2-4f8c-8c53-58a5e28affab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:38.526166 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4c22b88-38a2-4f8c-8c53-58a5e28affab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:38.527211 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4c22b88-38a2-4f8c-8c53-58a5e28affab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:38.527900 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4c22b88-38a2-4f8c-8c53-58a5e28affab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:38.528370 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4c22b88-38a2-4f8c-8c53-58a5e28affab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:38.528784 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4c22b88-38a2-4f8c-8c53-58a5e28affab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:38.659519 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a4c22b88-38a2-4f8c-8c53-58a5e28affab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:38.668584 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a4c22b88-38a2-4f8c-8c53-58a5e28affab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.153982 Aug 29 20:37:38.669188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 289/595] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:38 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:37:38.914177 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-902b0e2f-f26c-4db8-88e9-e1191e7b4209 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:38.914799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-902b0e2f-f26c-4db8-88e9-e1191e7b4209 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:38.921365 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-902b0e2f-f26c-4db8-88e9-e1191e7b4209 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:38.921851 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-902b0e2f-f26c-4db8-88e9-e1191e7b4209 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:38.922286 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-902b0e2f-f26c-4db8-88e9-e1191e7b4209 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:38.922980 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-902b0e2f-f26c-4db8-88e9-e1191e7b4209 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:38.923431 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-902b0e2f-f26c-4db8-88e9-e1191e7b4209 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:38.923858 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-902b0e2f-f26c-4db8-88e9-e1191e7b4209 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:39.070386 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-902b0e2f-f26c-4db8-88e9-e1191e7b4209 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:39.079317 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-902b0e2f-f26c-4db8-88e9-e1191e7b4209 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1759 microversion: 2.1 time: 0.169059 Aug 29 20:37:39.079895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 307/596] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:38 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:39.690575 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3c973139-d5e6-44d3-8d7a-7f5abafadde2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:39.691116 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3c973139-d5e6-44d3-8d7a-7f5abafadde2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:39.697950 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c973139-d5e6-44d3-8d7a-7f5abafadde2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:39.699074 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c973139-d5e6-44d3-8d7a-7f5abafadde2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:39.699672 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c973139-d5e6-44d3-8d7a-7f5abafadde2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:39.700414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c973139-d5e6-44d3-8d7a-7f5abafadde2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:39.700904 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c973139-d5e6-44d3-8d7a-7f5abafadde2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:39.701401 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3c973139-d5e6-44d3-8d7a-7f5abafadde2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:39.831641 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3c973139-d5e6-44d3-8d7a-7f5abafadde2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:39.840587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3c973139-d5e6-44d3-8d7a-7f5abafadde2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.154130 Aug 29 20:37:39.841182 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 290/597] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:39 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:37:40.862297 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-00e4c03e-4072-4f81-a0d2-f25df1f36894 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:40.862915 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-00e4c03e-4072-4f81-a0d2-f25df1f36894 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:40.868909 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00e4c03e-4072-4f81-a0d2-f25df1f36894 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:40.869393 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00e4c03e-4072-4f81-a0d2-f25df1f36894 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:40.869829 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00e4c03e-4072-4f81-a0d2-f25df1f36894 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:40.871127 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00e4c03e-4072-4f81-a0d2-f25df1f36894 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:40.871582 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00e4c03e-4072-4f81-a0d2-f25df1f36894 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:40.872045 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00e4c03e-4072-4f81-a0d2-f25df1f36894 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:41.010187 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-00e4c03e-4072-4f81-a0d2-f25df1f36894 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:41.019869 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-00e4c03e-4072-4f81-a0d2-f25df1f36894 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1736 microversion: 2.1 time: 0.161872 Aug 29 20:37:41.020456 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 308/598] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:40 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:42.043117 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b38e5367-69ce-4022-9c5d-72a41e0bda0a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:42.043815 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b38e5367-69ce-4022-9c5d-72a41e0bda0a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:42.050857 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38e5367-69ce-4022-9c5d-72a41e0bda0a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:42.051397 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38e5367-69ce-4022-9c5d-72a41e0bda0a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:42.051894 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38e5367-69ce-4022-9c5d-72a41e0bda0a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:42.052730 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38e5367-69ce-4022-9c5d-72a41e0bda0a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:42.053219 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38e5367-69ce-4022-9c5d-72a41e0bda0a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:42.053642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b38e5367-69ce-4022-9c5d-72a41e0bda0a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:42.187404 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-b38e5367-69ce-4022-9c5d-72a41e0bda0a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:42.196833 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b38e5367-69ce-4022-9c5d-72a41e0bda0a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1716 microversion: 2.1 time: 0.158459 Aug 29 20:37:42.197412 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 291/599] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:42 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:42.319759 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1e960865-7543-49fd-9bf3-da9e5f48d3ed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:42.320275 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1e960865-7543-49fd-9bf3-da9e5f48d3ed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:42.327255 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1e960865-7543-49fd-9bf3-da9e5f48d3ed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:42.327696 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1e960865-7543-49fd-9bf3-da9e5f48d3ed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:42.328178 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1e960865-7543-49fd-9bf3-da9e5f48d3ed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:42.328875 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1e960865-7543-49fd-9bf3-da9e5f48d3ed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:42.329327 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1e960865-7543-49fd-9bf3-da9e5f48d3ed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:42.329753 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1e960865-7543-49fd-9bf3-da9e5f48d3ed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:42.454178 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-1e960865-7543-49fd-9bf3-da9e5f48d3ed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] HTTP exception thrown: Cannot 'detach_volume' instance 64544993-4d2e-4125-9371-c55b598a4ab1 while it is in vm_state rescued Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1e960865-7543-49fd-9bf3-da9e5f48d3ed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Request method failure captured: Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: DELETE /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-volume_attachments/6fdb7e42-0867-478e-8b1f-42724c027963 HTTP/1.1 Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSJ-rwdl0t1Aj5l-1bGTIJFL-ZTxxAqt4Npmzg5SfQigz7qhWcnlSTLYkJ-kvIBMd62ylFVXsavpDA3ppxN3UCTRp7GeXqktCRuMiz1cX_UUXVeNdK0pTwdrrdVjfKv0odW_eu3KVvvRhEFMqiP8_f7uh50xlMra8Bbpcs0GLuMPJ8k Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 8436d85d931a41cfa6d626c08ad82ef4 Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:37:42.455773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:37:42.457384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8436d85d931a41cfa6d626c08ad82ef4"}]}] Aug 29 20:37:42.457384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:37:42.457384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 8436d85d931a41cfa6d626c08ad82ef4 Aug 29 20:37:42.457384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:37:42.457384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-ServerRescueNegativeTestJSON-1627718934-project Aug 29 20:37:42.457384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:37:42.457384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:37:42.457384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 8fbc5bd64315421e97931402fb0e3a6a Aug 29 20:37:42.457384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1627718934-project Aug 29 20:37:42.457384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:37:42.457384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Cannot 'detach_volume' instance 64544993-4d2e-4125-9371-c55b598a4ab1 while it is in vm_state rescued Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'server_id': '64544993-4d2e-4125-9371-c55b598a4ab1', 'id': '6fdb7e42-0867-478e-8b1f-42724c027963'} Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64544993-4d2e-4125-9371-c55b598a4ab1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:37:42.458330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 64544993-4d2e-4125-9371-c55b598a4ab1 while it is in vm_state rescued Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 64544993-4d2e-4125-9371-c55b598a4ab1 while it is in vm_state rescued Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:37:42.459866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1e960865-7543-49fd-9bf3-da9e5f48d3ed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Returning 409 to user: Cannot 'detach_volume' instance 64544993-4d2e-4125-9371-c55b598a4ab1 while it is in vm_state rescued {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:37:42.461208 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1e960865-7543-49fd-9bf3-da9e5f48d3ed tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "DELETE /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-volume_attachments/6fdb7e42-0867-478e-8b1f-42724c027963" status: 409 len: 152 microversion: 2.1 time: 0.141498 Aug 29 20:37:42.461208 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 309/600] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 29 20:37:42 2022] DELETE /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-volume_attachments/6fdb7e42-0867-478e-8b1f-42724c027963 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 20:37:42.466122 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-877fe9ba-818e-48d2-9aae-ac495abf09f1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:42.466749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-877fe9ba-818e-48d2-9aae-ac495abf09f1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:42.473288 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-877fe9ba-818e-48d2-9aae-ac495abf09f1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:42.473778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-877fe9ba-818e-48d2-9aae-ac495abf09f1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:42.474209 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-877fe9ba-818e-48d2-9aae-ac495abf09f1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:42.474909 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-877fe9ba-818e-48d2-9aae-ac495abf09f1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:42.475355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-877fe9ba-818e-48d2-9aae-ac495abf09f1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:42.475772 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-877fe9ba-818e-48d2-9aae-ac495abf09f1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:42.544871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-877fe9ba-818e-48d2-9aae-ac495abf09f1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "POST /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/action" status: 202 len: 0 microversion: 2.1 time: 0.082382 Aug 29 20:37:42.545515 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 292/601] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 29 20:37:42 2022] POST /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:37:42.554344 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-754ccbba-8b16-46ee-a7d8-1f15b9ee00b5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:42.554949 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-754ccbba-8b16-46ee-a7d8-1f15b9ee00b5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:42.562324 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-754ccbba-8b16-46ee-a7d8-1f15b9ee00b5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:42.562732 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-754ccbba-8b16-46ee-a7d8-1f15b9ee00b5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:42.563159 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-754ccbba-8b16-46ee-a7d8-1f15b9ee00b5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:42.563849 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-754ccbba-8b16-46ee-a7d8-1f15b9ee00b5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:42.564326 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-754ccbba-8b16-46ee-a7d8-1f15b9ee00b5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:42.564742 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-754ccbba-8b16-46ee-a7d8-1f15b9ee00b5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:42.704337 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-754ccbba-8b16-46ee-a7d8-1f15b9ee00b5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:42.717949 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-754ccbba-8b16-46ee-a7d8-1f15b9ee00b5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1724 microversion: 2.1 time: 0.167698 Aug 29 20:37:42.718995 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 310/602] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:42 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:43.753037 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0dc221f8-92ec-49b6-873b-8b991ac5987b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:43.753639 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0dc221f8-92ec-49b6-873b-8b991ac5987b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:43.760072 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0dc221f8-92ec-49b6-873b-8b991ac5987b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:43.760552 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0dc221f8-92ec-49b6-873b-8b991ac5987b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:43.761016 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0dc221f8-92ec-49b6-873b-8b991ac5987b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:43.761708 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0dc221f8-92ec-49b6-873b-8b991ac5987b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:43.762159 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0dc221f8-92ec-49b6-873b-8b991ac5987b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:43.762579 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0dc221f8-92ec-49b6-873b-8b991ac5987b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:43.896886 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0dc221f8-92ec-49b6-873b-8b991ac5987b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:43.905455 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0dc221f8-92ec-49b6-873b-8b991ac5987b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1724 microversion: 2.1 time: 0.157274 Aug 29 20:37:43.906017 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 293/603] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:43 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:44.927594 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d390ab65-6db7-490d-8d2d-80022c76a9d1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:44.928308 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d390ab65-6db7-490d-8d2d-80022c76a9d1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:44.935903 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d390ab65-6db7-490d-8d2d-80022c76a9d1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:44.936416 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d390ab65-6db7-490d-8d2d-80022c76a9d1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:44.936881 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d390ab65-6db7-490d-8d2d-80022c76a9d1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:44.937579 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d390ab65-6db7-490d-8d2d-80022c76a9d1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:44.938036 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d390ab65-6db7-490d-8d2d-80022c76a9d1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:44.938473 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d390ab65-6db7-490d-8d2d-80022c76a9d1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:45.079741 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d390ab65-6db7-490d-8d2d-80022c76a9d1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:45.088282 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d390ab65-6db7-490d-8d2d-80022c76a9d1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1724 microversion: 2.1 time: 0.164685 Aug 29 20:37:45.089486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 311/604] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:44 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:46.110207 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e296dcd6-b4ba-4e67-9a24-3139d1d1de68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:46.110878 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e296dcd6-b4ba-4e67-9a24-3139d1d1de68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:46.117467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e296dcd6-b4ba-4e67-9a24-3139d1d1de68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:46.117945 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e296dcd6-b4ba-4e67-9a24-3139d1d1de68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:46.118374 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e296dcd6-b4ba-4e67-9a24-3139d1d1de68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:46.119058 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e296dcd6-b4ba-4e67-9a24-3139d1d1de68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:46.119502 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e296dcd6-b4ba-4e67-9a24-3139d1d1de68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:46.119918 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e296dcd6-b4ba-4e67-9a24-3139d1d1de68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:46.253582 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e296dcd6-b4ba-4e67-9a24-3139d1d1de68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:46.262335 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e296dcd6-b4ba-4e67-9a24-3139d1d1de68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1730 microversion: 2.1 time: 0.156079 Aug 29 20:37:46.262902 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 294/605] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:46 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:37:46.283315 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-c7d108cd-404f-4f7a-9aea-ebc1980a3cb3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:46.283890 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-c7d108cd-404f-4f7a-9aea-ebc1980a3cb3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:46.291073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c7d108cd-404f-4f7a-9aea-ebc1980a3cb3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:46.291551 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c7d108cd-404f-4f7a-9aea-ebc1980a3cb3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:46.292627 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c7d108cd-404f-4f7a-9aea-ebc1980a3cb3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:46.293330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c7d108cd-404f-4f7a-9aea-ebc1980a3cb3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:46.293778 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c7d108cd-404f-4f7a-9aea-ebc1980a3cb3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:46.294200 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c7d108cd-404f-4f7a-9aea-ebc1980a3cb3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:46.374330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c7d108cd-404f-4f7a-9aea-ebc1980a3cb3 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094861 Aug 29 20:37:46.374919 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 312/606] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 29 20:37:46 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:37:47.265338 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-18f22ff7-5275-4df8-9047-2fdcef895cb9 req-67dfa7e8-e156-4333-aef7-2645ee7dec7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64544993-4d2e-4125-9371-c55b598a4ab1", "tag": "85b94151-961e-4568-b1f6-9b9ec1883e9a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:47.276974 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-18f22ff7-5275-4df8-9047-2fdcef895cb9 req-67dfa7e8-e156-4333-aef7-2645ee7dec7b service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:47.277464 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-18f22ff7-5275-4df8-9047-2fdcef895cb9 req-67dfa7e8-e156-4333-aef7-2645ee7dec7b service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:47.278383 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-18f22ff7-5275-4df8-9047-2fdcef895cb9 req-67dfa7e8-e156-4333-aef7-2645ee7dec7b service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:47.297935 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-18f22ff7-5275-4df8-9047-2fdcef895cb9 req-67dfa7e8-e156-4333-aef7-2645ee7dec7b service nova] Creating event network-changed:85b94151-961e-4568-b1f6-9b9ec1883e9a for instance 64544993-4d2e-4125-9371-c55b598a4ab1 on hv-cinder-85426 Aug 29 20:37:47.307261 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-18f22ff7-5275-4df8-9047-2fdcef895cb9 req-67dfa7e8-e156-4333-aef7-2645ee7dec7b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045449 Aug 29 20:37:47.307792 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 295/607] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:37:49.322802 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-448567fb-d6e1-4977-9144-9e77f9dc3cd1 req-941e05f1-8e5b-453a-84fb-33e0e53da5fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64544993-4d2e-4125-9371-c55b598a4ab1", "tag": "85b94151-961e-4568-b1f6-9b9ec1883e9a"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:49.332361 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-448567fb-d6e1-4977-9144-9e77f9dc3cd1 req-941e05f1-8e5b-453a-84fb-33e0e53da5fc service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:49.332838 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-448567fb-d6e1-4977-9144-9e77f9dc3cd1 req-941e05f1-8e5b-453a-84fb-33e0e53da5fc service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:49.333266 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-448567fb-d6e1-4977-9144-9e77f9dc3cd1 req-941e05f1-8e5b-453a-84fb-33e0e53da5fc service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:49.345407 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-448567fb-d6e1-4977-9144-9e77f9dc3cd1 req-941e05f1-8e5b-453a-84fb-33e0e53da5fc service nova] Creating event network-changed:85b94151-961e-4568-b1f6-9b9ec1883e9a for instance 64544993-4d2e-4125-9371-c55b598a4ab1 on hv-cinder-85426 Aug 29 20:37:49.350468 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-448567fb-d6e1-4977-9144-9e77f9dc3cd1 req-941e05f1-8e5b-453a-84fb-33e0e53da5fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031915 Aug 29 20:37:49.351065 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 313/608] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:37:55.100313 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4c913df7-6b87-4fa6-b50c-62db761c84cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:55.102612 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4c913df7-6b87-4fa6-b50c-62db761c84cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:55.109249 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c913df7-6b87-4fa6-b50c-62db761c84cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:55.109721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c913df7-6b87-4fa6-b50c-62db761c84cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:55.110146 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c913df7-6b87-4fa6-b50c-62db761c84cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:55.110826 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c913df7-6b87-4fa6-b50c-62db761c84cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:55.111270 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c913df7-6b87-4fa6-b50c-62db761c84cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:55.111684 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c913df7-6b87-4fa6-b50c-62db761c84cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:55.142302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4c913df7-6b87-4fa6-b50c-62db761c84cf tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046957 Aug 29 20:37:55.142847 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 296/609] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:37:55 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:37:55.205849 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1254293f-72d9-4a60-83bd-2dfc14ee891e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:55.206425 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1254293f-72d9-4a60-83bd-2dfc14ee891e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:55.212757 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1254293f-72d9-4a60-83bd-2dfc14ee891e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:55.213232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1254293f-72d9-4a60-83bd-2dfc14ee891e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:55.213661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1254293f-72d9-4a60-83bd-2dfc14ee891e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:55.214341 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1254293f-72d9-4a60-83bd-2dfc14ee891e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:55.214811 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1254293f-72d9-4a60-83bd-2dfc14ee891e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:55.215208 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1254293f-72d9-4a60-83bd-2dfc14ee891e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:55.239917 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1254293f-72d9-4a60-83bd-2dfc14ee891e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Going to try to terminate instance {{(pid=127027) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:37:55.319298 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1254293f-72d9-4a60-83bd-2dfc14ee891e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 204 len: 0 microversion: 2.1 time: 0.117235 Aug 29 20:37:55.319889 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 314/610] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:37:55 2022] DELETE /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:37:55.328229 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7bc9bea1-9701-4d20-8f15-36d22c527c6b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:55.328866 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7bc9bea1-9701-4d20-8f15-36d22c527c6b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:55.330794 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=42 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:55.336408 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bc9bea1-9701-4d20-8f15-36d22c527c6b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:55.337023 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bc9bea1-9701-4d20-8f15-36d22c527c6b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:55.337550 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bc9bea1-9701-4d20-8f15-36d22c527c6b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:55.338247 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bc9bea1-9701-4d20-8f15-36d22c527c6b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:55.338700 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bc9bea1-9701-4d20-8f15-36d22c527c6b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:55.339147 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7bc9bea1-9701-4d20-8f15-36d22c527c6b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:55.539219 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7bc9bea1-9701-4d20-8f15-36d22c527c6b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:55.547185 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7bc9bea1-9701-4d20-8f15-36d22c527c6b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1673 microversion: 2.1 time: 0.222988 Aug 29 20:37:55.547750 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 297/611] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:55 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1673 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:56.568715 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-15835a21-3ef4-4878-87dc-85a5061773f1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:56.569335 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-15835a21-3ef4-4878-87dc-85a5061773f1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:56.576376 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-15835a21-3ef4-4878-87dc-85a5061773f1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:56.577053 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-15835a21-3ef4-4878-87dc-85a5061773f1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:56.577322 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-15835a21-3ef4-4878-87dc-85a5061773f1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:56.578014 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-15835a21-3ef4-4878-87dc-85a5061773f1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:56.578462 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-15835a21-3ef4-4878-87dc-85a5061773f1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:56.578880 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-15835a21-3ef4-4878-87dc-85a5061773f1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:56.760767 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-15835a21-3ef4-4878-87dc-85a5061773f1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:56.769171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-15835a21-3ef4-4878-87dc-85a5061773f1 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1673 microversion: 2.1 time: 0.204793 Aug 29 20:37:56.769754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 315/612] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:56 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:57.790582 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1211ccf4-3e4d-41ea-a433-c933fa4732e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:57.791190 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1211ccf4-3e4d-41ea-a433-c933fa4732e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:57.797717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1211ccf4-3e4d-41ea-a433-c933fa4732e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:57.798183 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1211ccf4-3e4d-41ea-a433-c933fa4732e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:57.798613 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1211ccf4-3e4d-41ea-a433-c933fa4732e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:57.799297 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1211ccf4-3e4d-41ea-a433-c933fa4732e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:57.799772 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1211ccf4-3e4d-41ea-a433-c933fa4732e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:57.800217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1211ccf4-3e4d-41ea-a433-c933fa4732e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:57.964349 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1211ccf4-3e4d-41ea-a433-c933fa4732e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:57.973004 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1211ccf4-3e4d-41ea-a433-c933fa4732e9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1673 microversion: 2.1 time: 0.186661 Aug 29 20:37:57.973582 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 298/613] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:57 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:37:58.981596 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-3d146fb4-80c0-4012-867a-baa0d86b97df req-2ea5ad0f-c4a0-4881-bc79-8f1f008a6350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfdda123-bbf1-425b-b690-2d0919df08a2", "name": "network-vif-deleted", "tag": "98948443-f8c1-415f-85ca-da7736524db5"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:37:59.012519 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-3d146fb4-80c0-4012-867a-baa0d86b97df req-2ea5ad0f-c4a0-4881-bc79-8f1f008a6350 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:59.016248 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-3d146fb4-80c0-4012-867a-baa0d86b97df req-2ea5ad0f-c4a0-4881-bc79-8f1f008a6350 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:59.017301 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-3d146fb4-80c0-4012-867a-baa0d86b97df req-2ea5ad0f-c4a0-4881-bc79-8f1f008a6350 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:59.022810 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:59.034382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-3d146fb4-80c0-4012-867a-baa0d86b97df req-2ea5ad0f-c4a0-4881-bc79-8f1f008a6350 service nova] Creating event network-vif-deleted:98948443-f8c1-415f-85ca-da7736524db5 for instance dfdda123-bbf1-425b-b690-2d0919df08a2 on hv-cinder-85426 Aug 29 20:37:59.041794 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-3d146fb4-80c0-4012-867a-baa0d86b97df req-2ea5ad0f-c4a0-4881-bc79-8f1f008a6350 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064402 Aug 29 20:37:59.044068 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 316/614] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:37:59.139956 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3615874d-c06a-4154-a93e-0d5ffd5d7245 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:37:59.140672 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3615874d-c06a-4154-a93e-0d5ffd5d7245 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:37:59.147256 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3615874d-c06a-4154-a93e-0d5ffd5d7245 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:59.147907 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3615874d-c06a-4154-a93e-0d5ffd5d7245 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:59.148487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3615874d-c06a-4154-a93e-0d5ffd5d7245 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:59.149549 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3615874d-c06a-4154-a93e-0d5ffd5d7245 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:59.150137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3615874d-c06a-4154-a93e-0d5ffd5d7245 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:59.150635 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3615874d-c06a-4154-a93e-0d5ffd5d7245 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:59.174830 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:59.191236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3615874d-c06a-4154-a93e-0d5ffd5d7245 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:37:59.191954 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3615874d-c06a-4154-a93e-0d5ffd5d7245 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:37:59.192410 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3615874d-c06a-4154-a93e-0d5ffd5d7245 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:37:59.192867 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-3615874d-c06a-4154-a93e-0d5ffd5d7245 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lazy-loading 'fault' on Instance uuid dfdda123-bbf1-425b-b690-2d0919df08a2 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:37:59.240415 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3615874d-c06a-4154-a93e-0d5ffd5d7245 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:37:59.252124 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3615874d-c06a-4154-a93e-0d5ffd5d7245 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 200 len: 1326 microversion: 2.1 time: 0.259629 Aug 29 20:37:59.253652 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 299/615] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:37:58 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 1326 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:00.279269 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 20:38:00.279887 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Mon Aug 29 20:38:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 (ip 10.222.0.18) !!! Aug 29 20:38:00.284636 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4b756df7-f174-4fdb-9ddf-27b8690097d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:00.285655 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4b756df7-f174-4fdb-9ddf-27b8690097d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:00.294577 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b756df7-f174-4fdb-9ddf-27b8690097d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:00.295240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b756df7-f174-4fdb-9ddf-27b8690097d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:00.295673 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b756df7-f174-4fdb-9ddf-27b8690097d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:00.296404 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b756df7-f174-4fdb-9ddf-27b8690097d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:00.297129 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b756df7-f174-4fdb-9ddf-27b8690097d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:00.297250 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b756df7-f174-4fdb-9ddf-27b8690097d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:00.312450 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-4b756df7-f174-4fdb-9ddf-27b8690097d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] HTTP exception thrown: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4b756df7-f174-4fdb-9ddf-27b8690097d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Request method failure captured: Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 HTTP/1.1 Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSJ550n0mTWFeCR1Rx2HnjD7cOB8YzZlOIIoAKgjEkfzs28LZlv7QQvwoOS4apX0LYLc9iAPMAsg5ItOhGtlruDL9jr1B_QlZmmmqomvLf_QZccbEpAqP5tVn9H95DHdMq-HPYF087vkEv_81BMd2eoMCvw-XrT-0Yip5DwE8hvX878 Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 544c78c5c2c44219a7f236b24a107da4 Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:38:00.314082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:38:00.315692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_544c78c5c2c44219a7f236b24a107da4"}]}] Aug 29 20:38:00.315692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:38:00.315692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 544c78c5c2c44219a7f236b24a107da4 Aug 29 20:38:00.315692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:38:00.315692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeTestJSON-270891202-project Aug 29 20:38:00.315692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:38:00.315692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:38:00.315692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: adc5854ed52042369a9b153af7da4cfb Aug 29 20:38:00.315692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeTestJSON-270891202-project Aug 29 20:38:00.315692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:38:00.315692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:38:00.315692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': 'dfdda123-bbf1-425b-b690-2d0919df08a2'} Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:00.316821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:38:00.318440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:00.319836 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4b756df7-f174-4fdb-9ddf-27b8690097d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Returning 404 to user: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:00.319836 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4b756df7-f174-4fdb-9ddf-27b8690097d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 404 len: 111 microversion: 2.1 time: 0.038007 Aug 29 20:38:00.319836 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 317/616] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:00 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:00.324325 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f5ffb097-da05-436f-a834-5c0127a7c4ac tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '.version_select at 0x7f4863220ee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:00.329145 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f5ffb097-da05-436f-a834-5c0127a7c4ac tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [71d89fa8-fa41-47f7-8c6a-f9fbe0e7c8b9] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 20:38:01.336814 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [None req-f5ffb097-da05-436f-a834-5c0127a7c4ac tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [71d89fa8-fa41-47f7-8c6a-f9fbe0e7c8b9] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40116. Aug 29 20:38:01.357502 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f5ffb097-da05-436f-a834-5c0127a7c4ac tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-296670177" status: 202 len: 0 microversion: 2.1 time: 1.036368 Aug 29 20:38:01.357945 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 300/617] 10.222.0.18 () {58 vars in 1218 bytes} [Mon Aug 29 20:38:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-296670177 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:38:01.997690 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-615da70f-663a-4a80-8b76-8f67c1fc3bc4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Action: 'create', calling method: .version_select at 0x7f486322e3a0>, body: {"keypair": {"name": "tempest-keypair-1212785996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWy8xoXSrso8zviRNC+y5LjGPnKp5huOiTSEelsNz8jC/hvFEw1vwfFEG8rZIJHhMuZWN8pbqLDUqj70jwRQPRhVBfckyBv9+wZcrKqKwuT2sEMNJUUpEiHYigS8E1n/Q=="}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:02.013035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-615da70f-663a-4a80-8b76-8f67c1fc3bc4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Getting quotas for project 544c78c5c2c44219a7f236b24a107da4. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:38:02.019476 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-615da70f-663a-4a80-8b76-8f67c1fc3bc4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Getting quotas for user adc5854ed52042369a9b153af7da4cfb and project 544c78c5c2c44219a7f236b24a107da4. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:38:02.045198 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-615da70f-663a-4a80-8b76-8f67c1fc3bc4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051321 Aug 29 20:38:02.045752 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 318/618] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 29 20:38:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:03.538052 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-642585022", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "956a6ad1-026f-40ab-949a-8f68054ef5a2"}], "security_groups": [{"name": "tempest-securitygroup--920553808"}], "key_name": "tempest-keypair-1212785996", "user_data": "}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:03.649550 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] validate_networks() for [('956a6ad1-026f-40ab-949a-8f68054ef5a2', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:38:04.019313 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:38:04.019770 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:38:04.020277 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:38:04.020688 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:38:04.021156 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:38:04.030517 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:04.030996 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:04.031432 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:04.032198 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:04.032655 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:04.033078 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:04.050456 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Getting quotas for project 544c78c5c2c44219a7f236b24a107da4. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:38:04.054355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Getting quotas for user adc5854ed52042369a9b153af7da4cfb and project 544c78c5c2c44219a7f236b24a107da4. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:38:04.065517 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:38:04.067895 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:38:04.115168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a14c18b5-cd3a-4978-9dec-bca0e7112d81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.581967 Aug 29 20:38:04.116114 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 301/619] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:38:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:38:04.127890 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e6c1de71-e58a-4617-9382-4d648d307011 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:04.128505 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e6c1de71-e58a-4617-9382-4d648d307011 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:04.181889 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e6c1de71-e58a-4617-9382-4d648d307011 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:04.189859 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e6c1de71-e58a-4617-9382-4d648d307011 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1237 microversion: 2.1 time: 0.066442 Aug 29 20:38:04.190422 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 319/620] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:04 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:05.212701 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8fb69ad6-7d5b-41c5-affe-1146dbbaab81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:05.213311 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8fb69ad6-7d5b-41c5-affe-1146dbbaab81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:05.220194 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fb69ad6-7d5b-41c5-affe-1146dbbaab81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:05.220678 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fb69ad6-7d5b-41c5-affe-1146dbbaab81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:05.221112 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fb69ad6-7d5b-41c5-affe-1146dbbaab81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:05.221837 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fb69ad6-7d5b-41c5-affe-1146dbbaab81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:05.222316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fb69ad6-7d5b-41c5-affe-1146dbbaab81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:05.222738 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8fb69ad6-7d5b-41c5-affe-1146dbbaab81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:05.284671 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8fb69ad6-7d5b-41c5-affe-1146dbbaab81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:05.292551 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8fb69ad6-7d5b-41c5-affe-1146dbbaab81 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1289 microversion: 2.1 time: 0.085212 Aug 29 20:38:05.293131 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 302/621] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:05 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:06.316728 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b7a9fe85-c666-4655-9516-d3cbfb57b579 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:06.317386 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b7a9fe85-c666-4655-9516-d3cbfb57b579 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:06.319925 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 20:38:06.320096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Mon Aug 29 20:38:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 (ip 10.222.0.18) !!! Aug 29 20:38:06.322107 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:06.335372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7a9fe85-c666-4655-9516-d3cbfb57b579 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:06.335957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7a9fe85-c666-4655-9516-d3cbfb57b579 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:06.336721 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7a9fe85-c666-4655-9516-d3cbfb57b579 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:06.337081 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7a9fe85-c666-4655-9516-d3cbfb57b579 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:06.337535 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7a9fe85-c666-4655-9516-d3cbfb57b579 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:06.338057 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b7a9fe85-c666-4655-9516-d3cbfb57b579 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:06.587538 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b7a9fe85-c666-4655-9516-d3cbfb57b579 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:06.595159 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b7a9fe85-c666-4655-9516-d3cbfb57b579 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1362 microversion: 2.1 time: 0.284334 Aug 29 20:38:06.595737 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 320/622] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:06 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:06.889216 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-4b5c93dd-e69b-428e-8a80-82a09e46343c req-01730d46-e848-44f3-a7cf-8fdb7ce27e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe56a6be-788d-44c6-a116-577a344df4c7", "tag": "9679af1b-9201-413a-8503-93f6d6fc0954"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:06.900737 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4b5c93dd-e69b-428e-8a80-82a09e46343c req-01730d46-e848-44f3-a7cf-8fdb7ce27e84 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:06.901266 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4b5c93dd-e69b-428e-8a80-82a09e46343c req-01730d46-e848-44f3-a7cf-8fdb7ce27e84 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:06.901692 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4b5c93dd-e69b-428e-8a80-82a09e46343c req-01730d46-e848-44f3-a7cf-8fdb7ce27e84 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:06.913582 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-4b5c93dd-e69b-428e-8a80-82a09e46343c req-01730d46-e848-44f3-a7cf-8fdb7ce27e84 service nova] Creating event network-changed:9679af1b-9201-413a-8503-93f6d6fc0954 for instance fe56a6be-788d-44c6-a116-577a344df4c7 on hv-cinder-85426 Aug 29 20:38:06.919241 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-4b5c93dd-e69b-428e-8a80-82a09e46343c req-01730d46-e848-44f3-a7cf-8fdb7ce27e84 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035883 Aug 29 20:38:06.920284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 303/623] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:07.616759 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-afd50b58-9416-4090-893e-471fbbd8abb8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:07.617412 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-afd50b58-9416-4090-893e-471fbbd8abb8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:07.624769 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-afd50b58-9416-4090-893e-471fbbd8abb8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:07.625292 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-afd50b58-9416-4090-893e-471fbbd8abb8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:07.625732 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-afd50b58-9416-4090-893e-471fbbd8abb8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:07.626433 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-afd50b58-9416-4090-893e-471fbbd8abb8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:07.626890 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-afd50b58-9416-4090-893e-471fbbd8abb8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:07.627315 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-afd50b58-9416-4090-893e-471fbbd8abb8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:07.756737 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-afd50b58-9416-4090-893e-471fbbd8abb8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:07.765069 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-afd50b58-9416-4090-893e-471fbbd8abb8 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1362 microversion: 2.1 time: 0.153477 Aug 29 20:38:07.765641 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 321/624] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:07 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:08.787820 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1de30960-50db-48c0-8689-7e351ff71ded tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:08.788626 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1de30960-50db-48c0-8689-7e351ff71ded tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:08.795843 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1de30960-50db-48c0-8689-7e351ff71ded tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:08.796368 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1de30960-50db-48c0-8689-7e351ff71ded tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:08.796807 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1de30960-50db-48c0-8689-7e351ff71ded tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:08.797511 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1de30960-50db-48c0-8689-7e351ff71ded tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:08.797968 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1de30960-50db-48c0-8689-7e351ff71ded tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:08.798395 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1de30960-50db-48c0-8689-7e351ff71ded tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:08.934934 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1de30960-50db-48c0-8689-7e351ff71ded tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:08.943160 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1de30960-50db-48c0-8689-7e351ff71ded tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1362 microversion: 2.1 time: 0.159561 Aug 29 20:38:08.943729 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 304/625] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:08 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:09.964506 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-63b3cd8b-295e-4d6b-96ed-4cc350ca8131 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:09.965798 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-63b3cd8b-295e-4d6b-96ed-4cc350ca8131 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:09.972265 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-63b3cd8b-295e-4d6b-96ed-4cc350ca8131 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:09.972751 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-63b3cd8b-295e-4d6b-96ed-4cc350ca8131 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:09.973217 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-63b3cd8b-295e-4d6b-96ed-4cc350ca8131 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:09.974019 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-63b3cd8b-295e-4d6b-96ed-4cc350ca8131 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:09.974482 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-63b3cd8b-295e-4d6b-96ed-4cc350ca8131 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:09.974906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-63b3cd8b-295e-4d6b-96ed-4cc350ca8131 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:10.100850 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-63b3cd8b-295e-4d6b-96ed-4cc350ca8131 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:10.108480 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-63b3cd8b-295e-4d6b-96ed-4cc350ca8131 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1362 microversion: 2.1 time: 0.147954 Aug 29 20:38:10.109045 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 322/626] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:09 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:11.130983 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-62e35b04-0af2-4b26-8fb2-6ccf4fa02470 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:11.131597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-62e35b04-0af2-4b26-8fb2-6ccf4fa02470 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:11.138485 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-62e35b04-0af2-4b26-8fb2-6ccf4fa02470 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:11.138880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-62e35b04-0af2-4b26-8fb2-6ccf4fa02470 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:11.139321 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-62e35b04-0af2-4b26-8fb2-6ccf4fa02470 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:11.140057 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-62e35b04-0af2-4b26-8fb2-6ccf4fa02470 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:11.140478 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-62e35b04-0af2-4b26-8fb2-6ccf4fa02470 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:11.140902 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-62e35b04-0af2-4b26-8fb2-6ccf4fa02470 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:11.273042 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-62e35b04-0af2-4b26-8fb2-6ccf4fa02470 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:11.281357 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-62e35b04-0af2-4b26-8fb2-6ccf4fa02470 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1362 microversion: 2.1 time: 0.154349 Aug 29 20:38:11.281921 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 305/627] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:11 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:12.301939 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-bc53ade9-6fb8-4fe0-b6f9-1d0be22da7ca tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:12.302539 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-bc53ade9-6fb8-4fe0-b6f9-1d0be22da7ca tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:12.309827 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc53ade9-6fb8-4fe0-b6f9-1d0be22da7ca tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:12.310317 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc53ade9-6fb8-4fe0-b6f9-1d0be22da7ca tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:12.311013 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc53ade9-6fb8-4fe0-b6f9-1d0be22da7ca tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:12.311725 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc53ade9-6fb8-4fe0-b6f9-1d0be22da7ca tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:12.312215 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc53ade9-6fb8-4fe0-b6f9-1d0be22da7ca tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:12.312660 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bc53ade9-6fb8-4fe0-b6f9-1d0be22da7ca tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:12.446430 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-bc53ade9-6fb8-4fe0-b6f9-1d0be22da7ca tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:12.454517 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-bc53ade9-6fb8-4fe0-b6f9-1d0be22da7ca tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1362 microversion: 2.1 time: 0.156314 Aug 29 20:38:12.455018 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 323/628] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:12 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:13.076192 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c70a0072-7c6f-4ff0-9038-f13b88f4cd7c req-74769a93-522a-4892-86d3-a249dab31ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe56a6be-788d-44c6-a116-577a344df4c7", "name": "network-vif-plugged", "status": "completed", "tag": "9679af1b-9201-413a-8503-93f6d6fc0954"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:13.086183 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c70a0072-7c6f-4ff0-9038-f13b88f4cd7c req-74769a93-522a-4892-86d3-a249dab31ff3 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:13.086690 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c70a0072-7c6f-4ff0-9038-f13b88f4cd7c req-74769a93-522a-4892-86d3-a249dab31ff3 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:13.087133 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c70a0072-7c6f-4ff0-9038-f13b88f4cd7c req-74769a93-522a-4892-86d3-a249dab31ff3 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:13.099545 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c70a0072-7c6f-4ff0-9038-f13b88f4cd7c req-74769a93-522a-4892-86d3-a249dab31ff3 service nova] Creating event network-vif-plugged:9679af1b-9201-413a-8503-93f6d6fc0954 for instance fe56a6be-788d-44c6-a116-577a344df4c7 on hv-cinder-85426 Aug 29 20:38:13.105960 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c70a0072-7c6f-4ff0-9038-f13b88f4cd7c req-74769a93-522a-4892-86d3-a249dab31ff3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033954 Aug 29 20:38:13.106559 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 306/629] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:13.476065 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e2595db7-33e8-4618-b678-56da7eedfafa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:13.476675 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e2595db7-33e8-4618-b678-56da7eedfafa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:13.483182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e2595db7-33e8-4618-b678-56da7eedfafa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:13.483651 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e2595db7-33e8-4618-b678-56da7eedfafa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:13.484114 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e2595db7-33e8-4618-b678-56da7eedfafa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:13.484804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e2595db7-33e8-4618-b678-56da7eedfafa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:13.485256 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e2595db7-33e8-4618-b678-56da7eedfafa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:13.485939 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e2595db7-33e8-4618-b678-56da7eedfafa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:13.614905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e2595db7-33e8-4618-b678-56da7eedfafa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:13.624145 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e2595db7-33e8-4618-b678-56da7eedfafa tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1362 microversion: 2.1 time: 0.151828 Aug 29 20:38:13.624824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 324/630] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:13 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:14.641976 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:14.642741 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:14.647283 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-128ec7fb-64ef-47de-befc-e40ff8ea953b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:14.648001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-128ec7fb-64ef-47de-befc-e40ff8ea953b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:14.655470 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-128ec7fb-64ef-47de-befc-e40ff8ea953b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:14.655973 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-128ec7fb-64ef-47de-befc-e40ff8ea953b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:14.656410 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-128ec7fb-64ef-47de-befc-e40ff8ea953b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:14.657133 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-128ec7fb-64ef-47de-befc-e40ff8ea953b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:14.657583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-128ec7fb-64ef-47de-befc-e40ff8ea953b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:14.658006 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-128ec7fb-64ef-47de-befc-e40ff8ea953b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:14.790765 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-128ec7fb-64ef-47de-befc-e40ff8ea953b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:14.799064 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-128ec7fb-64ef-47de-befc-e40ff8ea953b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1362 microversion: 2.1 time: 0.158078 Aug 29 20:38:14.799625 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 307/631] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:14 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:15.820954 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-cef9c371-2eb3-47fb-af11-956e750f28d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:15.821550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-cef9c371-2eb3-47fb-af11-956e750f28d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:15.823455 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=6 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:15.829381 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cef9c371-2eb3-47fb-af11-956e750f28d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:15.829913 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cef9c371-2eb3-47fb-af11-956e750f28d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:15.830345 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cef9c371-2eb3-47fb-af11-956e750f28d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:15.831033 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cef9c371-2eb3-47fb-af11-956e750f28d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:15.831479 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cef9c371-2eb3-47fb-af11-956e750f28d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:15.831895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cef9c371-2eb3-47fb-af11-956e750f28d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:15.966103 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-cef9c371-2eb3-47fb-af11-956e750f28d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:15.974333 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-cef9c371-2eb3-47fb-af11-956e750f28d9 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1549 microversion: 2.1 time: 0.157650 Aug 29 20:38:15.974904 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 325/632] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:15 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:15.994451 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-77a071ac-e438-415e-b8a2-5acd0f35773b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:15.994955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-77a071ac-e438-415e-b8a2-5acd0f35773b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:16.002006 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77a071ac-e438-415e-b8a2-5acd0f35773b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:16.002401 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77a071ac-e438-415e-b8a2-5acd0f35773b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:16.002829 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77a071ac-e438-415e-b8a2-5acd0f35773b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:16.003516 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77a071ac-e438-415e-b8a2-5acd0f35773b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:16.004001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77a071ac-e438-415e-b8a2-5acd0f35773b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:16.004421 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77a071ac-e438-415e-b8a2-5acd0f35773b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:16.093046 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-77a071ac-e438-415e-b8a2-5acd0f35773b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102348 Aug 29 20:38:16.093637 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 308/633] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 29 20:38:15 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:17.021264 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-56a33442-d864-452c-b3a1-d16d008132d9 req-07a037b6-3dc6-45dd-b320-4a9ab13f6824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe56a6be-788d-44c6-a116-577a344df4c7", "tag": "9679af1b-9201-413a-8503-93f6d6fc0954"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:17.031410 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-56a33442-d864-452c-b3a1-d16d008132d9 req-07a037b6-3dc6-45dd-b320-4a9ab13f6824 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:17.031876 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-56a33442-d864-452c-b3a1-d16d008132d9 req-07a037b6-3dc6-45dd-b320-4a9ab13f6824 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:17.032330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-56a33442-d864-452c-b3a1-d16d008132d9 req-07a037b6-3dc6-45dd-b320-4a9ab13f6824 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:17.043598 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-56a33442-d864-452c-b3a1-d16d008132d9 req-07a037b6-3dc6-45dd-b320-4a9ab13f6824 service nova] Creating event network-changed:9679af1b-9201-413a-8503-93f6d6fc0954 for instance fe56a6be-788d-44c6-a116-577a344df4c7 on hv-cinder-85426 Aug 29 20:38:17.049128 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-56a33442-d864-452c-b3a1-d16d008132d9 req-07a037b6-3dc6-45dd-b320-4a9ab13f6824 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031561 Aug 29 20:38:17.050015 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 326/634] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:17.679320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fd44fc6a-264e-4904-ae89-f65c8abbef0d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:17.679963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fd44fc6a-264e-4904-ae89-f65c8abbef0d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:17.687532 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd44fc6a-264e-4904-ae89-f65c8abbef0d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:17.688470 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd44fc6a-264e-4904-ae89-f65c8abbef0d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:17.688590 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd44fc6a-264e-4904-ae89-f65c8abbef0d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:17.689305 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd44fc6a-264e-4904-ae89-f65c8abbef0d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:17.689758 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd44fc6a-264e-4904-ae89-f65c8abbef0d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:17.690180 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd44fc6a-264e-4904-ae89-f65c8abbef0d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:17.733052 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fd44fc6a-264e-4904-ae89-f65c8abbef0d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/os-volume_attachments/5e72a884-754c-4b9d-996e-862a7df189eb" status: 200 len: 194 microversion: 2.20 time: 0.058420 Aug 29 20:38:17.733668 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 309/635] 10.222.0.18 () {60 vars in 1454 bytes} [Mon Aug 29 20:38:17 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/os-volume_attachments/5e72a884-754c-4b9d-996e-862a7df189eb => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:38:17.805137 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ff8ce0e1-40d0-463f-8abf-9c4148564b4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:17.805721 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ff8ce0e1-40d0-463f-8abf-9c4148564b4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:17.813588 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ff8ce0e1-40d0-463f-8abf-9c4148564b4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:17.814083 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ff8ce0e1-40d0-463f-8abf-9c4148564b4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:17.814517 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ff8ce0e1-40d0-463f-8abf-9c4148564b4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:17.815229 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ff8ce0e1-40d0-463f-8abf-9c4148564b4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:17.815681 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ff8ce0e1-40d0-463f-8abf-9c4148564b4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:17.816726 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ff8ce0e1-40d0-463f-8abf-9c4148564b4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:17.901412 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-ff8ce0e1-40d0-463f-8abf-9c4148564b4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lazy-loading 'services' on Instance uuid 95026449-87b2-4f37-bfd3-554df7e6a037 {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:38:18.020699 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ff8ce0e1-40d0-463f-8abf-9c4148564b4a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/os-volume_attachments/5e72a884-754c-4b9d-996e-862a7df189eb" status: 202 len: 0 microversion: 2.20 time: 0.219909 Aug 29 20:38:18.021472 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 327/636] 10.222.0.18 () {60 vars in 1457 bytes} [Mon Aug 29 20:38:17 2022] DELETE /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/os-volume_attachments/5e72a884-754c-4b9d-996e-862a7df189eb => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:38:18.029851 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3ff38386-d870-4132-85bb-5c88cff9d2cc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:18.032082 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3ff38386-d870-4132-85bb-5c88cff9d2cc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:18.038293 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ff38386-d870-4132-85bb-5c88cff9d2cc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:18.039071 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ff38386-d870-4132-85bb-5c88cff9d2cc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:18.039466 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ff38386-d870-4132-85bb-5c88cff9d2cc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:18.040529 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ff38386-d870-4132-85bb-5c88cff9d2cc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:18.040969 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ff38386-d870-4132-85bb-5c88cff9d2cc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:18.041459 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3ff38386-d870-4132-85bb-5c88cff9d2cc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:18.075731 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3ff38386-d870-4132-85bb-5c88cff9d2cc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049747 Aug 29 20:38:18.076199 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 310/637] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Aug 29 20:38:18 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 20:38:19.089531 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2280a0cb-3908-4684-a54f-8d9b70b26e51 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:19.091878 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2280a0cb-3908-4684-a54f-8d9b70b26e51 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:19.098135 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2280a0cb-3908-4684-a54f-8d9b70b26e51 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:19.098605 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2280a0cb-3908-4684-a54f-8d9b70b26e51 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:19.099032 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2280a0cb-3908-4684-a54f-8d9b70b26e51 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:19.099716 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2280a0cb-3908-4684-a54f-8d9b70b26e51 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:19.100196 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2280a0cb-3908-4684-a54f-8d9b70b26e51 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:19.100610 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2280a0cb-3908-4684-a54f-8d9b70b26e51 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:19.131717 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2280a0cb-3908-4684-a54f-8d9b70b26e51 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046872 Aug 29 20:38:19.132217 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 328/638] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Aug 29 20:38:19 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:38:20.144705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e841e2d-ab7f-4dbd-8695-cb00c0cb588d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:20.146818 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e841e2d-ab7f-4dbd-8695-cb00c0cb588d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:20.153844 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e841e2d-ab7f-4dbd-8695-cb00c0cb588d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:20.154367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e841e2d-ab7f-4dbd-8695-cb00c0cb588d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:20.154783 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e841e2d-ab7f-4dbd-8695-cb00c0cb588d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:20.155469 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e841e2d-ab7f-4dbd-8695-cb00c0cb588d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:20.156044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e841e2d-ab7f-4dbd-8695-cb00c0cb588d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:20.156592 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e841e2d-ab7f-4dbd-8695-cb00c0cb588d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:20.186251 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e841e2d-ab7f-4dbd-8695-cb00c0cb588d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045450 Aug 29 20:38:20.186819 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 311/639] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Aug 29 20:38:20 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:20.247303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f91ab7f9-f09b-4a8c-9e2b-33fd9be54220 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:20.247840 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-f91ab7f9-f09b-4a8c-9e2b-33fd9be54220 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:20.254249 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f91ab7f9-f09b-4a8c-9e2b-33fd9be54220 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:20.254720 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f91ab7f9-f09b-4a8c-9e2b-33fd9be54220 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:20.255157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f91ab7f9-f09b-4a8c-9e2b-33fd9be54220 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:20.255824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f91ab7f9-f09b-4a8c-9e2b-33fd9be54220 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:20.256296 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f91ab7f9-f09b-4a8c-9e2b-33fd9be54220 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:20.256706 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f91ab7f9-f09b-4a8c-9e2b-33fd9be54220 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:20.283047 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-f91ab7f9-f09b-4a8c-9e2b-33fd9be54220 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Going to try to terminate instance {{(pid=127027) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:38:20.357904 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-f91ab7f9-f09b-4a8c-9e2b-33fd9be54220 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 204 len: 0 microversion: 2.20 time: 0.114154 Aug 29 20:38:20.359047 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 329/640] 10.222.0.18 () {60 vars in 1280 bytes} [Mon Aug 29 20:38:20 2022] DELETE /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 20:38:20.367141 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-68ab6085-17eb-4f4a-bc1a-3de398f0d5ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:20.367745 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-68ab6085-17eb-4f4a-bc1a-3de398f0d5ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:20.374015 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68ab6085-17eb-4f4a-bc1a-3de398f0d5ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:20.374489 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68ab6085-17eb-4f4a-bc1a-3de398f0d5ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:20.374917 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68ab6085-17eb-4f4a-bc1a-3de398f0d5ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:20.375608 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68ab6085-17eb-4f4a-bc1a-3de398f0d5ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:20.376091 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68ab6085-17eb-4f4a-bc1a-3de398f0d5ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:20.376511 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-68ab6085-17eb-4f4a-bc1a-3de398f0d5ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:20.506802 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-68ab6085-17eb-4f4a-bc1a-3de398f0d5ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:20.515423 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-68ab6085-17eb-4f4a-bc1a-3de398f0d5ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:20.516988 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-68ab6085-17eb-4f4a-bc1a-3de398f0d5ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:20.518707 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-68ab6085-17eb-4f4a-bc1a-3de398f0d5ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.155112 Aug 29 20:38:20.518707 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 312/641] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:20 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:21.544191 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-07e0099e-1eb4-42d7-adf9-09b1a947ff5d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:21.544886 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-07e0099e-1eb4-42d7-adf9-09b1a947ff5d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:21.551191 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-07e0099e-1eb4-42d7-adf9-09b1a947ff5d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:21.551669 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-07e0099e-1eb4-42d7-adf9-09b1a947ff5d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:21.552177 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-07e0099e-1eb4-42d7-adf9-09b1a947ff5d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:21.552862 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-07e0099e-1eb4-42d7-adf9-09b1a947ff5d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:21.553310 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-07e0099e-1eb4-42d7-adf9-09b1a947ff5d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:21.553823 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-07e0099e-1eb4-42d7-adf9-09b1a947ff5d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:21.688998 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-07e0099e-1eb4-42d7-adf9-09b1a947ff5d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:21.697143 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-07e0099e-1eb4-42d7-adf9-09b1a947ff5d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:21.698585 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-07e0099e-1eb4-42d7-adf9-09b1a947ff5d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:21.700437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-07e0099e-1eb4-42d7-adf9-09b1a947ff5d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.161247 Aug 29 20:38:21.701000 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 330/642] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:21 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:38:22.722636 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-465444e8-1264-4e29-839f-acd4535f1da4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:22.723243 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-465444e8-1264-4e29-839f-acd4535f1da4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:22.730492 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-465444e8-1264-4e29-839f-acd4535f1da4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:22.730972 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-465444e8-1264-4e29-839f-acd4535f1da4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:22.731394 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-465444e8-1264-4e29-839f-acd4535f1da4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:22.732108 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-465444e8-1264-4e29-839f-acd4535f1da4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:22.732552 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-465444e8-1264-4e29-839f-acd4535f1da4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:22.732975 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-465444e8-1264-4e29-839f-acd4535f1da4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:22.862283 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-465444e8-1264-4e29-839f-acd4535f1da4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:22.871011 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-465444e8-1264-4e29-839f-acd4535f1da4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:22.872843 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-465444e8-1264-4e29-839f-acd4535f1da4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:22.874005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-465444e8-1264-4e29-839f-acd4535f1da4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1721 microversion: 2.20 time: 0.155270 Aug 29 20:38:22.874553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 313/643] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:22 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:23.610486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-42841461-d9a9-4a70-abc1-75daa5adbc3f req-ea51ae63-723c-455b-bd85-222c954f7638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95026449-87b2-4f37-bfd3-554df7e6a037", "name": "network-vif-deleted", "tag": "87154a2a-cc60-4d5c-bce5-20690a774470"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:23.632031 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-42841461-d9a9-4a70-abc1-75daa5adbc3f req-ea51ae63-723c-455b-bd85-222c954f7638 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:23.632589 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-42841461-d9a9-4a70-abc1-75daa5adbc3f req-ea51ae63-723c-455b-bd85-222c954f7638 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:23.633118 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-42841461-d9a9-4a70-abc1-75daa5adbc3f req-ea51ae63-723c-455b-bd85-222c954f7638 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:23.645497 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-42841461-d9a9-4a70-abc1-75daa5adbc3f req-ea51ae63-723c-455b-bd85-222c954f7638 service nova] Creating event network-vif-deleted:87154a2a-cc60-4d5c-bce5-20690a774470 for instance 95026449-87b2-4f37-bfd3-554df7e6a037 on hv-cinder-85426 Aug 29 20:38:23.651346 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-42841461-d9a9-4a70-abc1-75daa5adbc3f req-ea51ae63-723c-455b-bd85-222c954f7638 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113765 Aug 29 20:38:23.652895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 331/644] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:23.897486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:23.898099 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:23.905368 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:23.905644 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:23.906073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:23.906770 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:23.907219 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:23.907634 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:23.941487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:23.941978 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:23.942405 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:23.942847 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lazy-loading 'fault' on Instance uuid 95026449-87b2-4f37-bfd3-554df7e6a037 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:38:23.990486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:23.998652 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:24.000096 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:24.001241 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dc085d65-3dfd-47c0-aca9-364bcc853099 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 200 len: 1370 microversion: 2.20 time: 0.107636 Aug 29 20:38:24.001798 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 314/645] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:23 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 1370 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:25.025440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d65c8439-83dc-41cc-b5bc-552a402cd289 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:25.026137 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d65c8439-83dc-41cc-b5bc-552a402cd289 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:25.032362 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d65c8439-83dc-41cc-b5bc-552a402cd289 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:25.032845 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d65c8439-83dc-41cc-b5bc-552a402cd289 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:25.033281 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d65c8439-83dc-41cc-b5bc-552a402cd289 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:25.033980 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d65c8439-83dc-41cc-b5bc-552a402cd289 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:25.034450 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d65c8439-83dc-41cc-b5bc-552a402cd289 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:25.034878 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d65c8439-83dc-41cc-b5bc-552a402cd289 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:25.049253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-d65c8439-83dc-41cc-b5bc-552a402cd289 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] HTTP exception thrown: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d65c8439-83dc-41cc-b5bc-552a402cd289 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Request method failure captured: Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 HTTP/1.1 Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSLllIGoYQVNJ19RkWKiIV7OLjtXRlQVmLOiuOjViYoOomBXMhB5rE-xIWnJg3Sl5boihtrMXQlk4M0OlxkHCnMMUBY2U-9TZ_pZ3V5AewnxytY6zCxGTuOh8hnKErSUKOdyTov-kf5-wdGl_ZzF92MY5rtcVHrYr3XA7-aZfcpLRz8 Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: bf00868e84384ee59320184a5e1c46c8 Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:38:25.050901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:38:25.052652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bf00868e84384ee59320184a5e1c46c8"}]}] Aug 29 20:38:25.052652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:38:25.052652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: bf00868e84384ee59320184a5e1c46c8 Aug 29 20:38:25.052652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:38:25.052652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeShelveTestJSON-889412031-project Aug 29 20:38:25.052652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:38:25.052652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:38:25.052652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 068f28eb74e74650a2b80d29664109ae Aug 29 20:38:25.052652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeShelveTestJSON-889412031-project Aug 29 20:38:25.052652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:38:25.052652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:38:25.052652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '95026449-87b2-4f37-bfd3-554df7e6a037'} Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:25.053515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:38:25.054803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:25.055875 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d65c8439-83dc-41cc-b5bc-552a402cd289 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Returning 404 to user: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:25.055875 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d65c8439-83dc-41cc-b5bc-552a402cd289 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 404 len: 111 microversion: 2.20 time: 0.031586 Aug 29 20:38:25.055875 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 332/646] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:25 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:38:25.062587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3a797a20-1358-468b-9a19-afe0c060f1c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '.version_select at 0x7f4863231670>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:25.081702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3a797a20-1358-468b-9a19-afe0c060f1c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-12196286" status: 204 len: 0 microversion: 2.20 time: 0.023978 Aug 29 20:38:25.082278 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 315/647] 10.222.0.18 () {60 vars in 1256 bytes} [Mon Aug 29 20:38:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-12196286 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 20:38:25.711455 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-030b0e46-d8eb-4322-a32e-943188959586 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Action: 'create', calling method: .version_select at 0x7f48632eb310>, body: {"keypair": {"name": "tempest-keypair-2039002236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVCzBJG4Txdvitl1O7Z2czmzEkrhG7I3o5OGNi31Bw4/4/s1CIjXrZMIyF6XBq3HkYgQADwf7PnIKtJE1smkvPsDaEb6gbjWjbwRpIeo5usnBwXBS2r855nX7d0aSBmLw=="}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:25.726649 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-030b0e46-d8eb-4322-a32e-943188959586 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Getting quotas for project bf00868e84384ee59320184a5e1c46c8. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:38:25.730961 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-030b0e46-d8eb-4322-a32e-943188959586 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Getting quotas for user 068f28eb74e74650a2b80d29664109ae and project bf00868e84384ee59320184a5e1c46c8. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:38:25.752772 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-030b0e46-d8eb-4322-a32e-943188959586 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045201 Aug 29 20:38:25.753393 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 333/648] 10.222.0.18 () {62 vars in 1200 bytes} [Mon Aug 29 20:38:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 20:38:27.266532 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1408796711", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0c2c5bd-a9a1-411b-a42c-01cbce56e13b"}], "security_groups": [{"name": "tempest-securitygroup--2130667750"}], "key_name": "tempest-keypair-2039002236", "user_data": "}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:27.275374 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:27.373428 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] validate_networks() for [('f0c2c5bd-a9a1-411b-a42c-01cbce56e13b', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:38:27.789553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:38:27.789969 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:38:27.790434 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:38:27.790837 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:38:27.791239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:38:27.800131 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:27.800614 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:27.801028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:27.801927 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:27.802370 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:27.802784 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:27.821089 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Getting quotas for project bf00868e84384ee59320184a5e1c46c8. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:38:27.827656 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Getting quotas for user 068f28eb74e74650a2b80d29664109ae and project bf00868e84384ee59320184a5e1c46c8. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:38:27.839721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:38:27.842041 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:38:27.889130 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f1be301d-5bd6-4e57-b98f-32ee1c9e3bc4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.627184 Aug 29 20:38:27.889783 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 316/649] 10.222.0.18 () {62 vars in 1188 bytes} [Mon Aug 29 20:38:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 20:38:27.902359 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1cc9a755-2bdf-42b8-84e6-f335d0c7ae54 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:27.902978 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1cc9a755-2bdf-42b8-84e6-f335d0c7ae54 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:27.959093 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1cc9a755-2bdf-42b8-84e6-f335d0c7ae54 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:27.967856 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1cc9a755-2bdf-42b8-84e6-f335d0c7ae54 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:27.969306 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1cc9a755-2bdf-42b8-84e6-f335d0c7ae54 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:27.970407 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1cc9a755-2bdf-42b8-84e6-f335d0c7ae54 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1282 microversion: 2.20 time: 0.073474 Aug 29 20:38:27.970955 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 334/650] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:27 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:28.992388 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-28fba3fa-de8e-4db2-aba5-e579948e50d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:28.992915 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-28fba3fa-de8e-4db2-aba5-e579948e50d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:28.999394 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28fba3fa-de8e-4db2-aba5-e579948e50d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:28.999878 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28fba3fa-de8e-4db2-aba5-e579948e50d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:29.000351 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28fba3fa-de8e-4db2-aba5-e579948e50d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:29.001041 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28fba3fa-de8e-4db2-aba5-e579948e50d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:29.001491 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28fba3fa-de8e-4db2-aba5-e579948e50d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:29.001912 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-28fba3fa-de8e-4db2-aba5-e579948e50d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:29.067407 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-28fba3fa-de8e-4db2-aba5-e579948e50d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:29.076152 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-28fba3fa-de8e-4db2-aba5-e579948e50d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:29.077686 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-28fba3fa-de8e-4db2-aba5-e579948e50d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:29.078776 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-28fba3fa-de8e-4db2-aba5-e579948e50d7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1334 microversion: 2.20 time: 0.090615 Aug 29 20:38:29.079443 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 317/651] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:28 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1334 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:29.611175 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-5d71d468-a10b-497c-a35c-2b2b76584748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1971690839"}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:29.611845 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-5d71d468-a10b-497c-a35c-2b2b76584748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:29.618230 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5d71d468-a10b-497c-a35c-2b2b76584748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:29.618710 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5d71d468-a10b-497c-a35c-2b2b76584748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:29.619145 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5d71d468-a10b-497c-a35c-2b2b76584748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:29.619839 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5d71d468-a10b-497c-a35c-2b2b76584748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:29.620820 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5d71d468-a10b-497c-a35c-2b2b76584748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:29.621219 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5d71d468-a10b-497c-a35c-2b2b76584748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:29.804919 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.network.security_group_api [None req-5d71d468-a10b-497c-a35c-2b2b76584748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Removing security group 60990b08-a3f2-46d1-bb04-9b1e1406ddc6 from port d63c8d5b-2b84-4f67-944f-9f299a5aa8cb Aug 29 20:38:30.102188 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc8f77d0-4288-4314-9bdf-bef8b38c0a0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:30.102798 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fc8f77d0-4288-4314-9bdf-bef8b38c0a0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:30.110281 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc8f77d0-4288-4314-9bdf-bef8b38c0a0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:30.111109 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc8f77d0-4288-4314-9bdf-bef8b38c0a0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:30.111610 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc8f77d0-4288-4314-9bdf-bef8b38c0a0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:30.112495 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc8f77d0-4288-4314-9bdf-bef8b38c0a0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:30.113162 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc8f77d0-4288-4314-9bdf-bef8b38c0a0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:30.113751 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc8f77d0-4288-4314-9bdf-bef8b38c0a0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:30.118701 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=85 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:30.182647 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc8f77d0-4288-4314-9bdf-bef8b38c0a0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:30.192651 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc8f77d0-4288-4314-9bdf-bef8b38c0a0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:30.194747 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc8f77d0-4288-4314-9bdf-bef8b38c0a0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:30.196217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc8f77d0-4288-4314-9bdf-bef8b38c0a0c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1340 microversion: 2.20 time: 0.098026 Aug 29 20:38:30.197055 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 318/652] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:30 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1340 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:38:30.357511 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-5d71d468-a10b-497c-a35c-2b2b76584748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "POST /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/action" status: 202 len: 0 microversion: 2.1 time: 0.748820 Aug 29 20:38:30.359440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 335/653] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 29 20:38:29 2022] POST /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:38:30.369461 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-ce6a8fdf-38bd-4a87-820a-2c7b90b5b04d req-0c4026cc-f385-49f2-94ed-59eb0566f373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68772d1-e335-4575-9654-313e27c49591", "tag": "d63c8d5b-2b84-4f67-944f-9f299a5aa8cb"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:30.382920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ce6a8fdf-38bd-4a87-820a-2c7b90b5b04d req-0c4026cc-f385-49f2-94ed-59eb0566f373 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:30.383598 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ce6a8fdf-38bd-4a87-820a-2c7b90b5b04d req-0c4026cc-f385-49f2-94ed-59eb0566f373 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:30.384251 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-ce6a8fdf-38bd-4a87-820a-2c7b90b5b04d req-0c4026cc-f385-49f2-94ed-59eb0566f373 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:30.396526 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-ce6a8fdf-38bd-4a87-820a-2c7b90b5b04d req-0c4026cc-f385-49f2-94ed-59eb0566f373 service nova] Creating event network-changed:d63c8d5b-2b84-4f67-944f-9f299a5aa8cb for instance b68772d1-e335-4575-9654-313e27c49591 on hv-cinder-85426 Aug 29 20:38:30.403266 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-ce6a8fdf-38bd-4a87-820a-2c7b90b5b04d req-0c4026cc-f385-49f2-94ed-59eb0566f373 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037549 Aug 29 20:38:30.404498 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 319/654] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:31.219713 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-da3e0942-2cf9-4ccd-8e6b-152e4a959776 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:31.220351 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-da3e0942-2cf9-4ccd-8e6b-152e4a959776 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:31.226542 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da3e0942-2cf9-4ccd-8e6b-152e4a959776 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:31.227110 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da3e0942-2cf9-4ccd-8e6b-152e4a959776 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:31.227616 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da3e0942-2cf9-4ccd-8e6b-152e4a959776 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:31.228415 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da3e0942-2cf9-4ccd-8e6b-152e4a959776 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:31.228938 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da3e0942-2cf9-4ccd-8e6b-152e4a959776 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:31.229431 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da3e0942-2cf9-4ccd-8e6b-152e4a959776 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:31.232867 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:31.503361 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-da3e0942-2cf9-4ccd-8e6b-152e4a959776 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:31.516249 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-da3e0942-2cf9-4ccd-8e6b-152e4a959776 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:31.518778 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-da3e0942-2cf9-4ccd-8e6b-152e4a959776 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:31.520291 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-da3e0942-2cf9-4ccd-8e6b-152e4a959776 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1408 microversion: 2.20 time: 0.305009 Aug 29 20:38:31.520923 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 336/655] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:31 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1408 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:32.447584 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-13092727-7d3b-45d9-911b-8477c5f3fdc4 req-b5d726c8-2555-470f-8a72-725644404592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8c3779-360e-43b6-8c43-50a3008159ea", "tag": "13477485-5060-4306-b273-b24627558f04"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:32.459901 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-13092727-7d3b-45d9-911b-8477c5f3fdc4 req-b5d726c8-2555-470f-8a72-725644404592 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.460419 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-13092727-7d3b-45d9-911b-8477c5f3fdc4 req-b5d726c8-2555-470f-8a72-725644404592 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.460846 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-13092727-7d3b-45d9-911b-8477c5f3fdc4 req-b5d726c8-2555-470f-8a72-725644404592 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.472356 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-13092727-7d3b-45d9-911b-8477c5f3fdc4 req-b5d726c8-2555-470f-8a72-725644404592 service nova] Creating event network-changed:13477485-5060-4306-b273-b24627558f04 for instance bb8c3779-360e-43b6-8c43-50a3008159ea on hv-cinder-85426 Aug 29 20:38:32.477224 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-13092727-7d3b-45d9-911b-8477c5f3fdc4 req-b5d726c8-2555-470f-8a72-725644404592 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034158 Aug 29 20:38:32.477825 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 320/656] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:38:32.544793 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2811cd87-48b4-4842-a552-185cc1b25646 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:32.545450 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2811cd87-48b4-4842-a552-185cc1b25646 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:32.551915 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2811cd87-48b4-4842-a552-185cc1b25646 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.552558 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2811cd87-48b4-4842-a552-185cc1b25646 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.553001 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2811cd87-48b4-4842-a552-185cc1b25646 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.553719 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2811cd87-48b4-4842-a552-185cc1b25646 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.554174 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2811cd87-48b4-4842-a552-185cc1b25646 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.554600 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2811cd87-48b4-4842-a552-185cc1b25646 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.648531 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-73581655-4057-4a2c-8b88-a8309439ffb4 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:32.649203 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-73581655-4057-4a2c-8b88-a8309439ffb4 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:32.656616 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73581655-4057-4a2c-8b88-a8309439ffb4 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.657097 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73581655-4057-4a2c-8b88-a8309439ffb4 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.657531 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73581655-4057-4a2c-8b88-a8309439ffb4 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.658233 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73581655-4057-4a2c-8b88-a8309439ffb4 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.658681 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73581655-4057-4a2c-8b88-a8309439ffb4 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.659103 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-73581655-4057-4a2c-8b88-a8309439ffb4 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.712472 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2811cd87-48b4-4842-a552-185cc1b25646 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:32.722286 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2811cd87-48b4-4842-a552-185cc1b25646 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:32.723735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2811cd87-48b4-4842-a552-185cc1b25646 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:32.724924 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2811cd87-48b4-4842-a552-185cc1b25646 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1408 microversion: 2.20 time: 0.185149 Aug 29 20:38:32.725812 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 337/657] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:32 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:32.748892 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-73581655-4057-4a2c-8b88-a8309439ffb4 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lazy-loading 'services' on Instance uuid b68772d1-e335-4575-9654-313e27c49591 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:38:32.826320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-73581655-4057-4a2c-8b88-a8309439ffb4 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/os-volume_attachments/bfd75817-72d1-44f9-8aec-fde22a8addff" status: 202 len: 0 microversion: 2.1 time: 0.181762 Aug 29 20:38:32.826811 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 321/658] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 29 20:38:32 2022] DELETE /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/os-volume_attachments/bfd75817-72d1-44f9-8aec-fde22a8addff => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:38:32.835427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-3a393022-3b11-49e5-ada4-5db9abe87b47 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:32.837863 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-3a393022-3b11-49e5-ada4-5db9abe87b47 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:32.844413 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3a393022-3b11-49e5-ada4-5db9abe87b47 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.845182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3a393022-3b11-49e5-ada4-5db9abe87b47 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.845629 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3a393022-3b11-49e5-ada4-5db9abe87b47 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.846339 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3a393022-3b11-49e5-ada4-5db9abe87b47 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:32.846794 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3a393022-3b11-49e5-ada4-5db9abe87b47 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:32.847467 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3a393022-3b11-49e5-ada4-5db9abe87b47 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:32.877372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-3a393022-3b11-49e5-ada4-5db9abe87b47 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045881 Aug 29 20:38:32.877942 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 338/659] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:38:32 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:38:33.748991 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f17d806f-b1f7-4f72-8e86-e902f6d248ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:33.749697 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f17d806f-b1f7-4f72-8e86-e902f6d248ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:33.756482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f17d806f-b1f7-4f72-8e86-e902f6d248ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:33.756968 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f17d806f-b1f7-4f72-8e86-e902f6d248ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:33.757405 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f17d806f-b1f7-4f72-8e86-e902f6d248ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:33.758109 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f17d806f-b1f7-4f72-8e86-e902f6d248ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:33.758560 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f17d806f-b1f7-4f72-8e86-e902f6d248ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:33.759036 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f17d806f-b1f7-4f72-8e86-e902f6d248ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:33.891079 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ad6848b1-57b5-4124-b4ee-3498c9c98ac7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:33.893334 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ad6848b1-57b5-4124-b4ee-3498c9c98ac7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:33.896913 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f17d806f-b1f7-4f72-8e86-e902f6d248ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:33.900169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ad6848b1-57b5-4124-b4ee-3498c9c98ac7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:33.900843 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ad6848b1-57b5-4124-b4ee-3498c9c98ac7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:33.901269 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ad6848b1-57b5-4124-b4ee-3498c9c98ac7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:33.902623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ad6848b1-57b5-4124-b4ee-3498c9c98ac7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:33.903065 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ad6848b1-57b5-4124-b4ee-3498c9c98ac7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:33.903480 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ad6848b1-57b5-4124-b4ee-3498c9c98ac7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:33.906224 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f17d806f-b1f7-4f72-8e86-e902f6d248ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:33.907694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f17d806f-b1f7-4f72-8e86-e902f6d248ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:33.908844 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f17d806f-b1f7-4f72-8e86-e902f6d248ea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1408 microversion: 2.20 time: 0.164246 Aug 29 20:38:33.909437 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 322/660] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:33 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:33.938454 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ad6848b1-57b5-4124-b4ee-3498c9c98ac7 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051417 Aug 29 20:38:33.939032 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 339/661] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:38:33 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:34.494580 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-344d32fb-957c-462a-839d-848a24b4014b req-6b3e4db4-6286-4e57-800b-c4112b2a83f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68772d1-e335-4575-9654-313e27c49591", "tag": "d63c8d5b-2b84-4f67-944f-9f299a5aa8cb"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:34.505320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-344d32fb-957c-462a-839d-848a24b4014b req-6b3e4db4-6286-4e57-800b-c4112b2a83f6 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:34.505793 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-344d32fb-957c-462a-839d-848a24b4014b req-6b3e4db4-6286-4e57-800b-c4112b2a83f6 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:34.506216 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-344d32fb-957c-462a-839d-848a24b4014b req-6b3e4db4-6286-4e57-800b-c4112b2a83f6 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:34.519107 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-344d32fb-957c-462a-839d-848a24b4014b req-6b3e4db4-6286-4e57-800b-c4112b2a83f6 service nova] Creating event network-changed:d63c8d5b-2b84-4f67-944f-9f299a5aa8cb for instance b68772d1-e335-4575-9654-313e27c49591 on hv-cinder-85426 Aug 29 20:38:34.524678 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-344d32fb-957c-462a-839d-848a24b4014b req-6b3e4db4-6286-4e57-800b-c4112b2a83f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034465 Aug 29 20:38:34.525282 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 323/662] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:34.930727 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a98bc809-755e-4b8a-a204-bf1b771ba221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:34.931952 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a98bc809-755e-4b8a-a204-bf1b771ba221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:34.940662 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a98bc809-755e-4b8a-a204-bf1b771ba221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:34.941405 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a98bc809-755e-4b8a-a204-bf1b771ba221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:34.941839 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a98bc809-755e-4b8a-a204-bf1b771ba221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:34.942557 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a98bc809-755e-4b8a-a204-bf1b771ba221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:34.943005 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a98bc809-755e-4b8a-a204-bf1b771ba221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:34.943636 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a98bc809-755e-4b8a-a204-bf1b771ba221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:34.953343 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8c4af635-83b6-4540-baa3-7aa551fc2d3d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:34.956758 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8c4af635-83b6-4540-baa3-7aa551fc2d3d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:34.963510 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c4af635-83b6-4540-baa3-7aa551fc2d3d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:34.964896 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c4af635-83b6-4540-baa3-7aa551fc2d3d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:34.965525 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c4af635-83b6-4540-baa3-7aa551fc2d3d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:34.966522 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c4af635-83b6-4540-baa3-7aa551fc2d3d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:34.967429 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c4af635-83b6-4540-baa3-7aa551fc2d3d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:34.968110 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8c4af635-83b6-4540-baa3-7aa551fc2d3d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:35.003350 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8c4af635-83b6-4540-baa3-7aa551fc2d3d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054105 Aug 29 20:38:35.004148 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 324/663] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:38:34 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 20:38:35.014456 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf43d3ee-247d-4cad-bfe8-229e5a209b27 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:35.015053 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cf43d3ee-247d-4cad-bfe8-229e5a209b27 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:35.033759 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf43d3ee-247d-4cad-bfe8-229e5a209b27 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:35.034254 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf43d3ee-247d-4cad-bfe8-229e5a209b27 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:35.034690 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf43d3ee-247d-4cad-bfe8-229e5a209b27 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:35.035402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf43d3ee-247d-4cad-bfe8-229e5a209b27 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:35.035853 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf43d3ee-247d-4cad-bfe8-229e5a209b27 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:35.036312 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cf43d3ee-247d-4cad-bfe8-229e5a209b27 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:35.133269 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-cf43d3ee-247d-4cad-bfe8-229e5a209b27 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] HTTP exception thrown: Instance b68772d1-e335-4575-9654-313e27c49591 is not attached to volume bfd75817-72d1-44f9-8aec-fde22a8addff Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf43d3ee-247d-4cad-bfe8-229e5a209b27 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Request method failure captured: Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/os-volume_attachments/bfd75817-72d1-44f9-8aec-fde22a8addff HTTP/1.1 Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSLfWzZP7j40O60vTl5ezvJH9Xkq_h6RBAiGAacF9VuXbHKx_QlDeTTm0iZQH6ypwSDHlpwbg4QGSOdJkwNeTzApPW3VZuf8QTwFiF-6KbLTRbaAwqqIEJrMWwSJAYVjkkrKaRj1lS1i2lB88Vwz20cMIpl1TVd8DqI_CtKrV9ommCc Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 3f36c1186e0f44df87d13ef836f6525b Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-TestMinimumBasicScenario-771445608 Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:38:35.142259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:38:35.143589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3f36c1186e0f44df87d13ef836f6525b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3f36c1186e0f44df87d13ef836f6525b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3f36c1186e0f44df87d13ef836f6525b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3f36c1186e0f44df87d13ef836f6525b"}]}] Aug 29 20:38:35.143589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-TestMinimumBasicScenario-771445608 Aug 29 20:38:35.143589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 3f36c1186e0f44df87d13ef836f6525b Aug 29 20:38:35.143589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestMinimumBasicScenario-771445608 Aug 29 20:38:35.143589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-TestMinimumBasicScenario-771445608-project Aug 29 20:38:35.143589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:38:35.143589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:38:35.143589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 448dc80e8c1b486fbdf83317209528eb Aug 29 20:38:35.143589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-TestMinimumBasicScenario-771445608-project Aug 29 20:38:35.143589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:38:35.143589 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance b68772d1-e335-4575-9654-313e27c49591 is not attached to volume bfd75817-72d1-44f9-8aec-fde22a8addff Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'server_id': 'b68772d1-e335-4575-9654-313e27c49591', 'id': 'bfd75817-72d1-44f9-8aec-fde22a8addff'} Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bfd75817-72d1-44f9-8aec-fde22a8addff. Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:35.144487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b68772d1-e335-4575-9654-313e27c49591 is not attached to volume bfd75817-72d1-44f9-8aec-fde22a8addff Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68772d1-e335-4575-9654-313e27c49591 is not attached to volume bfd75817-72d1-44f9-8aec-fde22a8addff Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:38:35.145669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cf43d3ee-247d-4cad-bfe8-229e5a209b27 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Returning 404 to user: Instance b68772d1-e335-4575-9654-313e27c49591 is not attached to volume bfd75817-72d1-44f9-8aec-fde22a8addff {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:35.147020 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cf43d3ee-247d-4cad-bfe8-229e5a209b27 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/os-volume_attachments/bfd75817-72d1-44f9-8aec-fde22a8addff" status: 404 len: 154 microversion: 2.1 time: 0.133526 Aug 29 20:38:35.148874 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 325/664] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 29 20:38:35 2022] DELETE /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591/os-volume_attachments/bfd75817-72d1-44f9-8aec-fde22a8addff => generated 154 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:38:35.155056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-967bdfbd-736b-483d-a718-d02118993d44 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:35.155551 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-967bdfbd-736b-483d-a718-d02118993d44 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:35.164507 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-967bdfbd-736b-483d-a718-d02118993d44 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:35.165050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-967bdfbd-736b-483d-a718-d02118993d44 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:35.165567 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-967bdfbd-736b-483d-a718-d02118993d44 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:35.166452 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-967bdfbd-736b-483d-a718-d02118993d44 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:35.167540 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-967bdfbd-736b-483d-a718-d02118993d44 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:35.168261 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-967bdfbd-736b-483d-a718-d02118993d44 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:35.171352 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a98bc809-755e-4b8a-a204-bf1b771ba221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:35.184813 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a98bc809-755e-4b8a-a204-bf1b771ba221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:35.187357 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a98bc809-755e-4b8a-a204-bf1b771ba221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:35.190209 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a98bc809-755e-4b8a-a204-bf1b771ba221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1408 microversion: 2.20 time: 0.263117 Aug 29 20:38:35.192285 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 340/665] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:34 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:35.298990 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-967bdfbd-736b-483d-a718-d02118993d44 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lazy-loading 'services' on Instance uuid 64544993-4d2e-4125-9371-c55b598a4ab1 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:38:35.372525 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-967bdfbd-736b-483d-a718-d02118993d44 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "DELETE /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-volume_attachments/6fdb7e42-0867-478e-8b1f-42724c027963" status: 202 len: 0 microversion: 2.1 time: 0.221808 Aug 29 20:38:35.373265 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 326/666] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 29 20:38:35 2022] DELETE /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-volume_attachments/6fdb7e42-0867-478e-8b1f-42724c027963 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:38:35.381803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a3170092-4a06-476e-8716-d7695e12e226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:35.384049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a3170092-4a06-476e-8716-d7695e12e226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:35.391531 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a3170092-4a06-476e-8716-d7695e12e226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:35.392044 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a3170092-4a06-476e-8716-d7695e12e226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:35.392480 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a3170092-4a06-476e-8716-d7695e12e226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:35.393288 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a3170092-4a06-476e-8716-d7695e12e226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:35.393833 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a3170092-4a06-476e-8716-d7695e12e226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:35.394259 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a3170092-4a06-476e-8716-d7695e12e226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:35.426470 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a3170092-4a06-476e-8716-d7695e12e226 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048535 Aug 29 20:38:35.427080 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 341/667] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:38:35 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:36.224395 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3d8e71eb-48aa-453d-8f6c-9e2cf72c7350 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:36.225184 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3d8e71eb-48aa-453d-8f6c-9e2cf72c7350 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:36.232413 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d8e71eb-48aa-453d-8f6c-9e2cf72c7350 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:36.232902 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d8e71eb-48aa-453d-8f6c-9e2cf72c7350 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:36.233338 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d8e71eb-48aa-453d-8f6c-9e2cf72c7350 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:36.234036 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d8e71eb-48aa-453d-8f6c-9e2cf72c7350 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:36.234489 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d8e71eb-48aa-453d-8f6c-9e2cf72c7350 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:36.234909 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d8e71eb-48aa-453d-8f6c-9e2cf72c7350 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:36.329440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-27624dc6-fa8c-4640-a388-ab065d9f62af tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:36.330162 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-27624dc6-fa8c-4640-a388-ab065d9f62af tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:36.336871 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-27624dc6-fa8c-4640-a388-ab065d9f62af tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:36.337335 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-27624dc6-fa8c-4640-a388-ab065d9f62af tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:36.337763 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-27624dc6-fa8c-4640-a388-ab065d9f62af tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:36.338450 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-27624dc6-fa8c-4640-a388-ab065d9f62af tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:36.339073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-27624dc6-fa8c-4640-a388-ab065d9f62af tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:36.339487 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-27624dc6-fa8c-4640-a388-ab065d9f62af tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:36.364990 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-27624dc6-fa8c-4640-a388-ab065d9f62af tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Going to try to terminate instance {{(pid=127027) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:38:36.380294 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d8e71eb-48aa-453d-8f6c-9e2cf72c7350 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:36.388408 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d8e71eb-48aa-453d-8f6c-9e2cf72c7350 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:36.389850 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3d8e71eb-48aa-453d-8f6c-9e2cf72c7350 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:36.390993 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3d8e71eb-48aa-453d-8f6c-9e2cf72c7350 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1408 microversion: 2.20 time: 0.172123 Aug 29 20:38:36.391545 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 327/668] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:36 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:36.429055 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:36.440071 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d5e2428b-1646-4ad3-9686-49d77317ac55 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:36.443088 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d5e2428b-1646-4ad3-9686-49d77317ac55 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:36.450292 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5e2428b-1646-4ad3-9686-49d77317ac55 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:36.451172 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-27624dc6-fa8c-4640-a388-ab065d9f62af tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 204 len: 0 microversion: 2.1 time: 0.125275 Aug 29 20:38:36.451682 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5e2428b-1646-4ad3-9686-49d77317ac55 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:36.451834 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 342/669] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:38:36 2022] DELETE /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:38:36.452598 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5e2428b-1646-4ad3-9686-49d77317ac55 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:36.453584 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5e2428b-1646-4ad3-9686-49d77317ac55 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:36.454053 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5e2428b-1646-4ad3-9686-49d77317ac55 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:36.454483 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5e2428b-1646-4ad3-9686-49d77317ac55 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:36.460249 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-90e848c8-75da-4bfd-8717-6285fec915fa tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:36.461277 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-90e848c8-75da-4bfd-8717-6285fec915fa tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:36.467883 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-90e848c8-75da-4bfd-8717-6285fec915fa tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:36.468494 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-90e848c8-75da-4bfd-8717-6285fec915fa tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:36.469020 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-90e848c8-75da-4bfd-8717-6285fec915fa tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:36.469806 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-90e848c8-75da-4bfd-8717-6285fec915fa tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:36.470356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-90e848c8-75da-4bfd-8717-6285fec915fa tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:36.470869 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-90e848c8-75da-4bfd-8717-6285fec915fa tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:36.486051 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d5e2428b-1646-4ad3-9686-49d77317ac55 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050436 Aug 29 20:38:36.486623 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 328/670] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:38:36 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:38:36.567036 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7192f890-d236-409c-a80c-7a44c4c96bf7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:36.567523 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7192f890-d236-409c-a80c-7a44c4c96bf7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:36.573916 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7192f890-d236-409c-a80c-7a44c4c96bf7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:36.574392 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7192f890-d236-409c-a80c-7a44c4c96bf7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:36.574818 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7192f890-d236-409c-a80c-7a44c4c96bf7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:36.575712 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7192f890-d236-409c-a80c-7a44c4c96bf7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:36.576196 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7192f890-d236-409c-a80c-7a44c4c96bf7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:36.576614 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7192f890-d236-409c-a80c-7a44c4c96bf7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:36.602739 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7192f890-d236-409c-a80c-7a44c4c96bf7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:38:36.610986 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-90e848c8-75da-4bfd-8717-6285fec915fa tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:36.618638 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-90e848c8-75da-4bfd-8717-6285fec915fa tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1554 microversion: 2.1 time: 0.162570 Aug 29 20:38:36.619212 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 343/671] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:36 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:38:36.680479 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7192f890-d236-409c-a80c-7a44c4c96bf7 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "DELETE /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 204 len: 0 microversion: 2.1 time: 0.116961 Aug 29 20:38:36.681053 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 329/672] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:38:36 2022] DELETE /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:38:36.689722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2a95dcf0-90d4-44a3-b35f-fede799a8d0c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:36.690344 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2a95dcf0-90d4-44a3-b35f-fede799a8d0c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:36.696537 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2a95dcf0-90d4-44a3-b35f-fede799a8d0c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:36.697019 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2a95dcf0-90d4-44a3-b35f-fede799a8d0c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:36.697449 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2a95dcf0-90d4-44a3-b35f-fede799a8d0c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:36.698200 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2a95dcf0-90d4-44a3-b35f-fede799a8d0c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:36.699154 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2a95dcf0-90d4-44a3-b35f-fede799a8d0c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:36.699572 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2a95dcf0-90d4-44a3-b35f-fede799a8d0c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:36.836681 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2a95dcf0-90d4-44a3-b35f-fede799a8d0c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:36.844347 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2a95dcf0-90d4-44a3-b35f-fede799a8d0c tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1690 microversion: 2.1 time: 0.158661 Aug 29 20:38:36.844906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 344/673] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:36 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:37.208028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-96f38fef-0ef6-4878-9083-4a8e7bd2a39e req-e4084caf-e537-46ad-a9fe-df9aed177559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8c3779-360e-43b6-8c43-50a3008159ea", "name": "network-vif-plugged", "status": "completed", "tag": "13477485-5060-4306-b273-b24627558f04"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:37.218709 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-96f38fef-0ef6-4878-9083-4a8e7bd2a39e req-e4084caf-e537-46ad-a9fe-df9aed177559 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:37.219336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-96f38fef-0ef6-4878-9083-4a8e7bd2a39e req-e4084caf-e537-46ad-a9fe-df9aed177559 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:37.219768 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-96f38fef-0ef6-4878-9083-4a8e7bd2a39e req-e4084caf-e537-46ad-a9fe-df9aed177559 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:37.232156 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-96f38fef-0ef6-4878-9083-4a8e7bd2a39e req-e4084caf-e537-46ad-a9fe-df9aed177559 service nova] Creating event network-vif-plugged:13477485-5060-4306-b273-b24627558f04 for instance bb8c3779-360e-43b6-8c43-50a3008159ea on hv-cinder-85426 Aug 29 20:38:37.237086 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-96f38fef-0ef6-4878-9083-4a8e7bd2a39e req-e4084caf-e537-46ad-a9fe-df9aed177559 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033152 Aug 29 20:38:37.237808 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 330/674] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:37.413905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d6559cc8-bdc3-4a3c-bb8a-66b29b0a7bef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:37.414445 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d6559cc8-bdc3-4a3c-bb8a-66b29b0a7bef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:37.421325 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6559cc8-bdc3-4a3c-bb8a-66b29b0a7bef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:37.421800 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6559cc8-bdc3-4a3c-bb8a-66b29b0a7bef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:37.422229 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6559cc8-bdc3-4a3c-bb8a-66b29b0a7bef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:37.422915 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6559cc8-bdc3-4a3c-bb8a-66b29b0a7bef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:37.423358 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6559cc8-bdc3-4a3c-bb8a-66b29b0a7bef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:37.423832 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6559cc8-bdc3-4a3c-bb8a-66b29b0a7bef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:37.552663 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d6559cc8-bdc3-4a3c-bb8a-66b29b0a7bef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:37.561549 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d6559cc8-bdc3-4a3c-bb8a-66b29b0a7bef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:37.563021 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d6559cc8-bdc3-4a3c-bb8a-66b29b0a7bef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:37.564178 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d6559cc8-bdc3-4a3c-bb8a-66b29b0a7bef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1408 microversion: 2.20 time: 0.154232 Aug 29 20:38:37.564733 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 345/675] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:37 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:37.641279 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1472fa46-ac18-4a3c-8cfe-20e30e7ad48e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:37.641964 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1472fa46-ac18-4a3c-8cfe-20e30e7ad48e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:37.648421 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1472fa46-ac18-4a3c-8cfe-20e30e7ad48e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:37.648894 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1472fa46-ac18-4a3c-8cfe-20e30e7ad48e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:37.649320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1472fa46-ac18-4a3c-8cfe-20e30e7ad48e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:37.650005 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1472fa46-ac18-4a3c-8cfe-20e30e7ad48e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:37.650450 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1472fa46-ac18-4a3c-8cfe-20e30e7ad48e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:37.650863 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1472fa46-ac18-4a3c-8cfe-20e30e7ad48e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:37.780908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1472fa46-ac18-4a3c-8cfe-20e30e7ad48e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:37.788793 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1472fa46-ac18-4a3c-8cfe-20e30e7ad48e tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1554 microversion: 2.1 time: 0.151810 Aug 29 20:38:37.789357 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 331/676] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:37 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:37.866129 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a9137346-986c-46f6-885b-bf09db90128a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:37.866919 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a9137346-986c-46f6-885b-bf09db90128a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:37.874112 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a9137346-986c-46f6-885b-bf09db90128a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:37.874603 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a9137346-986c-46f6-885b-bf09db90128a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:37.875044 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a9137346-986c-46f6-885b-bf09db90128a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:37.875739 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a9137346-986c-46f6-885b-bf09db90128a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:37.876227 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a9137346-986c-46f6-885b-bf09db90128a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:37.876651 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a9137346-986c-46f6-885b-bf09db90128a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:37.963464 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=6 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:38.015532 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a9137346-986c-46f6-885b-bf09db90128a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:38.023141 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a9137346-986c-46f6-885b-bf09db90128a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1690 microversion: 2.1 time: 0.161290 Aug 29 20:38:38.024458 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 346/677] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:37 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:38.587392 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e1940c3-25a9-47f8-9201-774c692790a2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:38.587951 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e1940c3-25a9-47f8-9201-774c692790a2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:38.589896 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:38.590559 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:38.596736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e1940c3-25a9-47f8-9201-774c692790a2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:38.597224 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e1940c3-25a9-47f8-9201-774c692790a2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:38.597658 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e1940c3-25a9-47f8-9201-774c692790a2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:38.598354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e1940c3-25a9-47f8-9201-774c692790a2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:38.598803 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e1940c3-25a9-47f8-9201-774c692790a2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:38.599225 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e1940c3-25a9-47f8-9201-774c692790a2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:38.734334 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e1940c3-25a9-47f8-9201-774c692790a2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:38.742466 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e1940c3-25a9-47f8-9201-774c692790a2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:38.743895 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e1940c3-25a9-47f8-9201-774c692790a2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:38.745056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e1940c3-25a9-47f8-9201-774c692790a2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1408 microversion: 2.20 time: 0.161753 Aug 29 20:38:38.745615 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 332/678] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:38 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:38.810923 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-eebabe70-56a2-4335-8f73-89183da29e5d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:38.811653 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-eebabe70-56a2-4335-8f73-89183da29e5d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:38.818269 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eebabe70-56a2-4335-8f73-89183da29e5d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:38.818753 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eebabe70-56a2-4335-8f73-89183da29e5d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:38.819190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eebabe70-56a2-4335-8f73-89183da29e5d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:38.819885 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eebabe70-56a2-4335-8f73-89183da29e5d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:38.820369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eebabe70-56a2-4335-8f73-89183da29e5d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:38.820793 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eebabe70-56a2-4335-8f73-89183da29e5d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:38.954854 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-eebabe70-56a2-4335-8f73-89183da29e5d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:38.962717 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-eebabe70-56a2-4335-8f73-89183da29e5d tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1554 microversion: 2.1 time: 0.155989 Aug 29 20:38:38.963469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 347/679] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:38 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:39.045253 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-841bf4a8-5585-47a7-84a9-25c07c3d0d56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:39.045862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-841bf4a8-5585-47a7-84a9-25c07c3d0d56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:39.051841 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-841bf4a8-5585-47a7-84a9-25c07c3d0d56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:39.052354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-841bf4a8-5585-47a7-84a9-25c07c3d0d56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:39.052786 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-841bf4a8-5585-47a7-84a9-25c07c3d0d56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:39.053471 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-841bf4a8-5585-47a7-84a9-25c07c3d0d56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:39.053921 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-841bf4a8-5585-47a7-84a9-25c07c3d0d56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:39.054344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-841bf4a8-5585-47a7-84a9-25c07c3d0d56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:39.185616 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-841bf4a8-5585-47a7-84a9-25c07c3d0d56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:39.193216 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-841bf4a8-5585-47a7-84a9-25c07c3d0d56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1690 microversion: 2.1 time: 0.152342 Aug 29 20:38:39.193770 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 333/680] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:39 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:39.768251 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-706f81a3-a08e-4f57-b387-c6fd3f372ff1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:39.768773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-706f81a3-a08e-4f57-b387-c6fd3f372ff1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:39.774743 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-706f81a3-a08e-4f57-b387-c6fd3f372ff1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:39.775220 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-706f81a3-a08e-4f57-b387-c6fd3f372ff1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:39.775642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-706f81a3-a08e-4f57-b387-c6fd3f372ff1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:39.777004 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-706f81a3-a08e-4f57-b387-c6fd3f372ff1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:39.777444 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-706f81a3-a08e-4f57-b387-c6fd3f372ff1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:39.777857 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-706f81a3-a08e-4f57-b387-c6fd3f372ff1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:39.910250 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-706f81a3-a08e-4f57-b387-c6fd3f372ff1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:39.918260 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-706f81a3-a08e-4f57-b387-c6fd3f372ff1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:39.919719 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-706f81a3-a08e-4f57-b387-c6fd3f372ff1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:39.920846 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-706f81a3-a08e-4f57-b387-c6fd3f372ff1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1408 microversion: 2.20 time: 0.156734 Aug 29 20:38:39.921395 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 348/681] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:39 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:38:39.984383 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-83e989d6-a312-4253-ab88-9a4c615fe492 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:39.984980 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-83e989d6-a312-4253-ab88-9a4c615fe492 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:39.991316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83e989d6-a312-4253-ab88-9a4c615fe492 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:39.991791 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83e989d6-a312-4253-ab88-9a4c615fe492 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:39.992258 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83e989d6-a312-4253-ab88-9a4c615fe492 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:39.992943 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83e989d6-a312-4253-ab88-9a4c615fe492 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:39.993392 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83e989d6-a312-4253-ab88-9a4c615fe492 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:39.993805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83e989d6-a312-4253-ab88-9a4c615fe492 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:40.008394 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:40.130414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-83e989d6-a312-4253-ab88-9a4c615fe492 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:40.138618 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-83e989d6-a312-4253-ab88-9a4c615fe492 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1554 microversion: 2.1 time: 0.158053 Aug 29 20:38:40.139242 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 334/682] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:39 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:40.214177 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7b5d2305-d9e7-4032-99e4-3ec9ec31dcd2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:40.214813 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7b5d2305-d9e7-4032-99e4-3ec9ec31dcd2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:40.220741 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7b5d2305-d9e7-4032-99e4-3ec9ec31dcd2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:40.221214 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7b5d2305-d9e7-4032-99e4-3ec9ec31dcd2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:40.221639 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7b5d2305-d9e7-4032-99e4-3ec9ec31dcd2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:40.222315 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7b5d2305-d9e7-4032-99e4-3ec9ec31dcd2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:40.222756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7b5d2305-d9e7-4032-99e4-3ec9ec31dcd2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:40.223165 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7b5d2305-d9e7-4032-99e4-3ec9ec31dcd2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:40.358606 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7b5d2305-d9e7-4032-99e4-3ec9ec31dcd2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:40.366501 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7b5d2305-d9e7-4032-99e4-3ec9ec31dcd2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1690 microversion: 2.1 time: 0.156280 Aug 29 20:38:40.367064 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 349/683] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:40 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:40.942993 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5203e0b0-36b2-45a0-9cd5-3a71543468be tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:40.943601 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5203e0b0-36b2-45a0-9cd5-3a71543468be tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:40.950343 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5203e0b0-36b2-45a0-9cd5-3a71543468be tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:40.950826 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5203e0b0-36b2-45a0-9cd5-3a71543468be tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:40.951269 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5203e0b0-36b2-45a0-9cd5-3a71543468be tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:40.951978 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5203e0b0-36b2-45a0-9cd5-3a71543468be tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:40.952453 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5203e0b0-36b2-45a0-9cd5-3a71543468be tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:40.952874 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5203e0b0-36b2-45a0-9cd5-3a71543468be tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:41.083269 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5203e0b0-36b2-45a0-9cd5-3a71543468be tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:41.091260 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5203e0b0-36b2-45a0-9cd5-3a71543468be tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:41.092722 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5203e0b0-36b2-45a0-9cd5-3a71543468be tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:41.093828 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5203e0b0-36b2-45a0-9cd5-3a71543468be tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1408 microversion: 2.20 time: 0.154968 Aug 29 20:38:41.094548 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 335/684] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:40 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:41.159604 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e0af6cdf-016c-4605-8491-2242f794f748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:41.160238 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e0af6cdf-016c-4605-8491-2242f794f748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:41.166846 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e0af6cdf-016c-4605-8491-2242f794f748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:41.167297 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e0af6cdf-016c-4605-8491-2242f794f748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:41.167733 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e0af6cdf-016c-4605-8491-2242f794f748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:41.168454 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e0af6cdf-016c-4605-8491-2242f794f748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:41.168906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e0af6cdf-016c-4605-8491-2242f794f748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:41.169336 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e0af6cdf-016c-4605-8491-2242f794f748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:41.298998 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e0af6cdf-016c-4605-8491-2242f794f748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:41.306993 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e0af6cdf-016c-4605-8491-2242f794f748 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1554 microversion: 2.1 time: 0.151212 Aug 29 20:38:41.308231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 350/685] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:41 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:41.387973 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1e69c7c3-5c5e-4b89-bec5-7170663f74e4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:41.388582 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1e69c7c3-5c5e-4b89-bec5-7170663f74e4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:41.394544 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e69c7c3-5c5e-4b89-bec5-7170663f74e4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:41.395026 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e69c7c3-5c5e-4b89-bec5-7170663f74e4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:41.395497 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e69c7c3-5c5e-4b89-bec5-7170663f74e4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:41.396219 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e69c7c3-5c5e-4b89-bec5-7170663f74e4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:41.396669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e69c7c3-5c5e-4b89-bec5-7170663f74e4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:41.397091 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1e69c7c3-5c5e-4b89-bec5-7170663f74e4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:41.528209 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1e69c7c3-5c5e-4b89-bec5-7170663f74e4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:41.536137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1e69c7c3-5c5e-4b89-bec5-7170663f74e4 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1690 microversion: 2.1 time: 0.152008 Aug 29 20:38:41.536698 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 336/686] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:41 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:41.808333 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f728de87-2647-4779-b650-e2278b769fd6 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:41.808859 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-f728de87-2647-4779-b650-e2278b769fd6 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:41.815044 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f728de87-2647-4779-b650-e2278b769fd6 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:41.815521 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f728de87-2647-4779-b650-e2278b769fd6 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:41.816073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f728de87-2647-4779-b650-e2278b769fd6 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:41.816760 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f728de87-2647-4779-b650-e2278b769fd6 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:41.817211 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f728de87-2647-4779-b650-e2278b769fd6 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:41.817632 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f728de87-2647-4779-b650-e2278b769fd6 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:41.820017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:41.843179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-f728de87-2647-4779-b650-e2278b769fd6 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lazy-loading 'flavor' on Instance uuid f36516f8-3de4-45fa-a124-83436dcfe1c1 {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:38:41.917404 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-f728de87-2647-4779-b650-e2278b769fd6 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "POST /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1/action" status: 202 len: 0 microversion: 2.1 time: 0.112198 Aug 29 20:38:41.917987 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 351/687] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 29 20:38:41 2022] POST /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:38:41.926252 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3e255a77-7e11-4c9a-889b-8d1b1c6e112f tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:41.926902 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3e255a77-7e11-4c9a-889b-8d1b1c6e112f tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:41.933027 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e255a77-7e11-4c9a-889b-8d1b1c6e112f tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:41.933508 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e255a77-7e11-4c9a-889b-8d1b1c6e112f tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:41.933940 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e255a77-7e11-4c9a-889b-8d1b1c6e112f tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:41.934633 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e255a77-7e11-4c9a-889b-8d1b1c6e112f tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:41.935080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e255a77-7e11-4c9a-889b-8d1b1c6e112f tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:41.935755 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3e255a77-7e11-4c9a-889b-8d1b1c6e112f tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:42.071688 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3e255a77-7e11-4c9a-889b-8d1b1c6e112f tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:42.080930 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3e255a77-7e11-4c9a-889b-8d1b1c6e112f tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.158333 Aug 29 20:38:42.081609 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 337/688] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:41 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:42.116213 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-00ce45f4-fc90-4a5c-8fdb-7777eeaa4c08 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:42.117038 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-00ce45f4-fc90-4a5c-8fdb-7777eeaa4c08 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:42.123419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00ce45f4-fc90-4a5c-8fdb-7777eeaa4c08 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:42.124003 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00ce45f4-fc90-4a5c-8fdb-7777eeaa4c08 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:42.124440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00ce45f4-fc90-4a5c-8fdb-7777eeaa4c08 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:42.125131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00ce45f4-fc90-4a5c-8fdb-7777eeaa4c08 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:42.125577 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00ce45f4-fc90-4a5c-8fdb-7777eeaa4c08 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:42.125992 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-00ce45f4-fc90-4a5c-8fdb-7777eeaa4c08 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:42.268789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-00ce45f4-fc90-4a5c-8fdb-7777eeaa4c08 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:42.277270 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-00ce45f4-fc90-4a5c-8fdb-7777eeaa4c08 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:42.278735 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-00ce45f4-fc90-4a5c-8fdb-7777eeaa4c08 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:42.279861 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-00ce45f4-fc90-4a5c-8fdb-7777eeaa4c08 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1408 microversion: 2.20 time: 0.167975 Aug 29 20:38:42.280461 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 352/689] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:42 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:42.330741 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b8944ca-c2eb-4da0-9632-ec9eaf707c8a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:42.331279 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7b8944ca-c2eb-4da0-9632-ec9eaf707c8a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:42.337718 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b8944ca-c2eb-4da0-9632-ec9eaf707c8a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:42.338194 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b8944ca-c2eb-4da0-9632-ec9eaf707c8a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:42.338718 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b8944ca-c2eb-4da0-9632-ec9eaf707c8a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:42.339456 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b8944ca-c2eb-4da0-9632-ec9eaf707c8a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:42.339903 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b8944ca-c2eb-4da0-9632-ec9eaf707c8a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:42.340346 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b8944ca-c2eb-4da0-9632-ec9eaf707c8a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:42.471960 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7b8944ca-c2eb-4da0-9632-ec9eaf707c8a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:42.480382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7b8944ca-c2eb-4da0-9632-ec9eaf707c8a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1554 microversion: 2.1 time: 0.153571 Aug 29 20:38:42.480950 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 338/690] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:42 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:42.557133 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-cefe4e62-9e1d-42d4-b760-a9312d022215 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:42.557741 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-cefe4e62-9e1d-42d4-b760-a9312d022215 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:42.564019 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cefe4e62-9e1d-42d4-b760-a9312d022215 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:42.564505 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cefe4e62-9e1d-42d4-b760-a9312d022215 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:42.564926 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cefe4e62-9e1d-42d4-b760-a9312d022215 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:42.565638 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cefe4e62-9e1d-42d4-b760-a9312d022215 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:42.566084 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cefe4e62-9e1d-42d4-b760-a9312d022215 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:42.566592 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cefe4e62-9e1d-42d4-b760-a9312d022215 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:42.698110 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-cefe4e62-9e1d-42d4-b760-a9312d022215 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:42.706035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-cefe4e62-9e1d-42d4-b760-a9312d022215 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1690 microversion: 2.1 time: 0.152797 Aug 29 20:38:42.706603 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 353/691] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:42 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:43.103377 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3de2d58f-78c8-4e2b-8135-3e99a5d8f26c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:43.104059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3de2d58f-78c8-4e2b-8135-3e99a5d8f26c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:43.110437 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3de2d58f-78c8-4e2b-8135-3e99a5d8f26c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:43.110919 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3de2d58f-78c8-4e2b-8135-3e99a5d8f26c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:43.111353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3de2d58f-78c8-4e2b-8135-3e99a5d8f26c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:43.112072 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3de2d58f-78c8-4e2b-8135-3e99a5d8f26c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:43.112546 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3de2d58f-78c8-4e2b-8135-3e99a5d8f26c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:43.112949 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3de2d58f-78c8-4e2b-8135-3e99a5d8f26c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:43.302504 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f42cfe17-98cb-4d6e-9922-6281bb38ecf6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:43.303124 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-f42cfe17-98cb-4d6e-9922-6281bb38ecf6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:43.310464 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f42cfe17-98cb-4d6e-9922-6281bb38ecf6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:43.310958 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f42cfe17-98cb-4d6e-9922-6281bb38ecf6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:43.311389 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f42cfe17-98cb-4d6e-9922-6281bb38ecf6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:43.312176 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f42cfe17-98cb-4d6e-9922-6281bb38ecf6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:43.312579 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f42cfe17-98cb-4d6e-9922-6281bb38ecf6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:43.313000 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f42cfe17-98cb-4d6e-9922-6281bb38ecf6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:43.450438 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-f42cfe17-98cb-4d6e-9922-6281bb38ecf6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:43.458525 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-f42cfe17-98cb-4d6e-9922-6281bb38ecf6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:43.459987 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-f42cfe17-98cb-4d6e-9922-6281bb38ecf6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:43.461106 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-f42cfe17-98cb-4d6e-9922-6281bb38ecf6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1408 microversion: 2.20 time: 0.162552 Aug 29 20:38:43.461661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 354/692] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:43 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:38:43.485890 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3de2d58f-78c8-4e2b-8135-3e99a5d8f26c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:43.494268 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3de2d58f-78c8-4e2b-8135-3e99a5d8f26c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.395123 Aug 29 20:38:43.495256 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 339/693] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:43 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:43.502382 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b8485b0e-e859-459a-88dc-61923220c88b tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:43.503537 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b8485b0e-e859-459a-88dc-61923220c88b tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:43.509999 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b8485b0e-e859-459a-88dc-61923220c88b tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:43.511210 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b8485b0e-e859-459a-88dc-61923220c88b tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:43.511712 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b8485b0e-e859-459a-88dc-61923220c88b tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:43.512517 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b8485b0e-e859-459a-88dc-61923220c88b tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:43.513055 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b8485b0e-e859-459a-88dc-61923220c88b tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:43.513546 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b8485b0e-e859-459a-88dc-61923220c88b tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:43.664792 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b8485b0e-e859-459a-88dc-61923220c88b tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:43.674021 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b8485b0e-e859-459a-88dc-61923220c88b tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1554 microversion: 2.1 time: 0.175711 Aug 29 20:38:43.675354 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 355/694] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:43 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:43.728789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-440d941d-26a3-48d7-aeeb-070a02dd0e61 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:43.729907 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-440d941d-26a3-48d7-aeeb-070a02dd0e61 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:43.738053 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-440d941d-26a3-48d7-aeeb-070a02dd0e61 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:43.740950 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-440d941d-26a3-48d7-aeeb-070a02dd0e61 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:43.741413 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-440d941d-26a3-48d7-aeeb-070a02dd0e61 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:43.742120 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-440d941d-26a3-48d7-aeeb-070a02dd0e61 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:43.742731 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-440d941d-26a3-48d7-aeeb-070a02dd0e61 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:43.743308 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-440d941d-26a3-48d7-aeeb-070a02dd0e61 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:43.817231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-440d941d-26a3-48d7-aeeb-070a02dd0e61 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:43.818720 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-dc9bce61-6008-4554-aa96-7287d0670fa6 req-3e241cf4-a8fd-4e62-9a9d-e461389ba600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68772d1-e335-4575-9654-313e27c49591", "name": "network-vif-deleted", "tag": "d63c8d5b-2b84-4f67-944f-9f299a5aa8cb"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:43.826750 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-440d941d-26a3-48d7-aeeb-070a02dd0e61 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1623 microversion: 2.1 time: 0.101707 Aug 29 20:38:43.828060 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 356/695] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:43 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1623 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:38:43.831238 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-dc9bce61-6008-4554-aa96-7287d0670fa6 req-3e241cf4-a8fd-4e62-9a9d-e461389ba600 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:43.831723 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-dc9bce61-6008-4554-aa96-7287d0670fa6 req-3e241cf4-a8fd-4e62-9a9d-e461389ba600 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:43.832193 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-dc9bce61-6008-4554-aa96-7287d0670fa6 req-3e241cf4-a8fd-4e62-9a9d-e461389ba600 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:43.849864 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-dc9bce61-6008-4554-aa96-7287d0670fa6 req-3e241cf4-a8fd-4e62-9a9d-e461389ba600 service nova] Creating event network-vif-deleted:d63c8d5b-2b84-4f67-944f-9f299a5aa8cb for instance b68772d1-e335-4575-9654-313e27c49591 on hv-cinder-85426 Aug 29 20:38:43.855906 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-dc9bce61-6008-4554-aa96-7287d0670fa6 req-3e241cf4-a8fd-4e62-9a9d-e461389ba600 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148064 Aug 29 20:38:43.856754 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 340/696] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:44.482918 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ef272c84-1142-4f2a-b1b4-4bbd7e1cbc8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:44.483565 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ef272c84-1142-4f2a-b1b4-4bbd7e1cbc8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:44.490297 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ef272c84-1142-4f2a-b1b4-4bbd7e1cbc8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:44.490767 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ef272c84-1142-4f2a-b1b4-4bbd7e1cbc8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:44.491210 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ef272c84-1142-4f2a-b1b4-4bbd7e1cbc8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:44.491876 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ef272c84-1142-4f2a-b1b4-4bbd7e1cbc8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:44.492344 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ef272c84-1142-4f2a-b1b4-4bbd7e1cbc8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:44.492758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ef272c84-1142-4f2a-b1b4-4bbd7e1cbc8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:44.518057 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-345d09b3-5e2f-4a1e-85e6-f79f7897d7fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:44.518742 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-345d09b3-5e2f-4a1e-85e6-f79f7897d7fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:44.525363 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-345d09b3-5e2f-4a1e-85e6-f79f7897d7fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:44.526780 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-345d09b3-5e2f-4a1e-85e6-f79f7897d7fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:44.527211 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-345d09b3-5e2f-4a1e-85e6-f79f7897d7fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:44.528098 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-345d09b3-5e2f-4a1e-85e6-f79f7897d7fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:44.528719 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-345d09b3-5e2f-4a1e-85e6-f79f7897d7fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:44.529137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-345d09b3-5e2f-4a1e-85e6-f79f7897d7fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:44.676652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-ef272c84-1142-4f2a-b1b4-4bbd7e1cbc8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:44.690312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-ef272c84-1142-4f2a-b1b4-4bbd7e1cbc8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:44.694935 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-ef272c84-1142-4f2a-b1b4-4bbd7e1cbc8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:44.698869 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ef272c84-1142-4f2a-b1b4-4bbd7e1cbc8a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1408 microversion: 2.20 time: 0.219304 Aug 29 20:38:44.703260 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 357/697] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:44 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:44.718738 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-655fecc1-8e86-4393-a1d2-115e738c0e68 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:44.720182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-655fecc1-8e86-4393-a1d2-115e738c0e68 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:44.727182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-655fecc1-8e86-4393-a1d2-115e738c0e68 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:44.727678 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-655fecc1-8e86-4393-a1d2-115e738c0e68 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:44.728189 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-655fecc1-8e86-4393-a1d2-115e738c0e68 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:44.729194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-655fecc1-8e86-4393-a1d2-115e738c0e68 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:44.729820 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-655fecc1-8e86-4393-a1d2-115e738c0e68 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:44.730766 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-655fecc1-8e86-4393-a1d2-115e738c0e68 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:44.753687 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-345d09b3-5e2f-4a1e-85e6-f79f7897d7fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:44.767677 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-655fecc1-8e86-4393-a1d2-115e738c0e68 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:44.768261 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-655fecc1-8e86-4393-a1d2-115e738c0e68 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:44.768567 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-345d09b3-5e2f-4a1e-85e6-f79f7897d7fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.255840 Aug 29 20:38:44.768705 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-655fecc1-8e86-4393-a1d2-115e738c0e68 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:44.769149 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-655fecc1-8e86-4393-a1d2-115e738c0e68 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lazy-loading 'fault' on Instance uuid b68772d1-e335-4575-9654-313e27c49591 {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:38:44.769304 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 341/698] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:44 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:38:44.827033 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-655fecc1-8e86-4393-a1d2-115e738c0e68 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448dc80e8c1b486fbdf83317209528eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36c1186e0f44df87d13ef836f6525b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:44.843685 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-655fecc1-8e86-4393-a1d2-115e738c0e68 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 200 len: 1348 microversion: 2.1 time: 0.139261 Aug 29 20:38:44.844751 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 358/699] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:44 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 1348 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:44.848511 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0420a998-9acb-4bd9-9f72-0c58f97fd6aa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:44.849331 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0420a998-9acb-4bd9-9f72-0c58f97fd6aa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:44.865288 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0420a998-9acb-4bd9-9f72-0c58f97fd6aa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:44.866164 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0420a998-9acb-4bd9-9f72-0c58f97fd6aa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:44.866834 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0420a998-9acb-4bd9-9f72-0c58f97fd6aa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:44.867740 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0420a998-9acb-4bd9-9f72-0c58f97fd6aa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:44.868637 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0420a998-9acb-4bd9-9f72-0c58f97fd6aa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:44.870227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0420a998-9acb-4bd9-9f72-0c58f97fd6aa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:44.910550 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0420a998-9acb-4bd9-9f72-0c58f97fd6aa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:44.911042 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0420a998-9acb-4bd9-9f72-0c58f97fd6aa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:44.911481 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0420a998-9acb-4bd9-9f72-0c58f97fd6aa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:44.912010 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-0420a998-9acb-4bd9-9f72-0c58f97fd6aa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lazy-loading 'fault' on Instance uuid 64544993-4d2e-4125-9371-c55b598a4ab1 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:38:44.962585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0420a998-9acb-4bd9-9f72-0c58f97fd6aa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:44.972516 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0420a998-9acb-4bd9-9f72-0c58f97fd6aa tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 200 len: 1335 microversion: 2.1 time: 0.128561 Aug 29 20:38:44.973093 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 342/700] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:44 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 1335 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:38:45.726487 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-eb26fdd8-c941-4b7b-a085-da917c2aec2b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:45.727579 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-eb26fdd8-c941-4b7b-a085-da917c2aec2b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:45.739801 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eb26fdd8-c941-4b7b-a085-da917c2aec2b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:45.740686 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eb26fdd8-c941-4b7b-a085-da917c2aec2b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:45.741456 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eb26fdd8-c941-4b7b-a085-da917c2aec2b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:45.742682 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eb26fdd8-c941-4b7b-a085-da917c2aec2b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:45.743516 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eb26fdd8-c941-4b7b-a085-da917c2aec2b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:45.744336 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-eb26fdd8-c941-4b7b-a085-da917c2aec2b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:45.793852 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fe49230d-6056-4b2c-a945-6541f8dc412c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:45.794705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fe49230d-6056-4b2c-a945-6541f8dc412c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:45.802317 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe49230d-6056-4b2c-a945-6541f8dc412c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:45.803058 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe49230d-6056-4b2c-a945-6541f8dc412c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:45.803583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe49230d-6056-4b2c-a945-6541f8dc412c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:45.804359 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe49230d-6056-4b2c-a945-6541f8dc412c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:45.804875 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe49230d-6056-4b2c-a945-6541f8dc412c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:45.805448 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fe49230d-6056-4b2c-a945-6541f8dc412c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:45.918056 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-eb26fdd8-c941-4b7b-a085-da917c2aec2b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:45.926592 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-eb26fdd8-c941-4b7b-a085-da917c2aec2b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:45.928046 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-eb26fdd8-c941-4b7b-a085-da917c2aec2b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:45.929202 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-eb26fdd8-c941-4b7b-a085-da917c2aec2b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1599 microversion: 2.20 time: 0.210248 Aug 29 20:38:45.929896 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 359/701] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:38:45 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:38:45.934294 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f415b689-fa20-4c2f-87bd-9ed957a5f594 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:45.934884 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-f415b689-fa20-4c2f-87bd-9ed957a5f594 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] [instance: b68772d1-e335-4575-9654-313e27c49591] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:45.941837 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f415b689-fa20-4c2f-87bd-9ed957a5f594 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:45.942309 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f415b689-fa20-4c2f-87bd-9ed957a5f594 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:45.942932 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f415b689-fa20-4c2f-87bd-9ed957a5f594 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:45.943626 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f415b689-fa20-4c2f-87bd-9ed957a5f594 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:45.944179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f415b689-fa20-4c2f-87bd-9ed957a5f594 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:45.944596 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f415b689-fa20-4c2f-87bd-9ed957a5f594 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:45.956131 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-fe49230d-6056-4b2c-a945-6541f8dc412c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:45.959236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-f415b689-fa20-4c2f-87bd-9ed957a5f594 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] HTTP exception thrown: Instance b68772d1-e335-4575-9654-313e27c49591 could not be found. Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f415b689-fa20-4c2f-87bd-9ed957a5f594 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Request method failure captured: Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 HTTP/1.1 Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSLfWzZP7j40O60vTl5ezvJH9Xkq_h6RBAiGAacF9VuXbHKx_QlDeTTm0iZQH6ypwSDHlpwbg4QGSOdJkwNeTzApPW3VZuf8QTwFiF-6KbLTRbaAwqqIEJrMWwSJAYVjkkrKaRj1lS1i2lB88Vwz20cMIpl1TVd8DqI_CtKrV9ommCc Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 3f36c1186e0f44df87d13ef836f6525b Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-TestMinimumBasicScenario-771445608 Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:38:45.960922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:38:45.962437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3f36c1186e0f44df87d13ef836f6525b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3f36c1186e0f44df87d13ef836f6525b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3f36c1186e0f44df87d13ef836f6525b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3f36c1186e0f44df87d13ef836f6525b"}]}] Aug 29 20:38:45.962437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-TestMinimumBasicScenario-771445608 Aug 29 20:38:45.962437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 3f36c1186e0f44df87d13ef836f6525b Aug 29 20:38:45.962437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-TestMinimumBasicScenario-771445608 Aug 29 20:38:45.962437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-TestMinimumBasicScenario-771445608-project Aug 29 20:38:45.962437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:38:45.962437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:38:45.962437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 448dc80e8c1b486fbdf83317209528eb Aug 29 20:38:45.962437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-TestMinimumBasicScenario-771445608-project Aug 29 20:38:45.962437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:38:45.962437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance b68772d1-e335-4575-9654-313e27c49591 could not be found. Aug 29 20:38:45.962437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': 'b68772d1-e335-4575-9654-313e27c49591'} Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b68772d1-e335-4575-9654-313e27c49591 could not be found. Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:45.963190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b68772d1-e335-4575-9654-313e27c49591 could not be found. Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68772d1-e335-4575-9654-313e27c49591 could not be found. Aug 29 20:38:45.965241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:45.966486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f415b689-fa20-4c2f-87bd-9ed957a5f594 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Returning 404 to user: Instance b68772d1-e335-4575-9654-313e27c49591 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:45.966486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-f415b689-fa20-4c2f-87bd-9ed957a5f594 tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591" status: 404 len: 111 microversion: 2.1 time: 0.031521 Aug 29 20:38:45.966486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 360/702] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:45 2022] GET /compute/v2.1/servers/b68772d1-e335-4575-9654-313e27c49591 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:45.968015 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-bea308d1-b26a-4e91-897c-6d69aa559533 req-472b17e9-bca4-4aff-8479-609cbe8ed908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64544993-4d2e-4125-9371-c55b598a4ab1", "name": "network-vif-deleted", "tag": "85b94151-961e-4568-b1f6-9b9ec1883e9a"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:45.969907 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fe49230d-6056-4b2c-a945-6541f8dc412c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.182838 Aug 29 20:38:45.970570 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 343/703] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:45 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:38:45.975658 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-87dd0211-2ab3-4147-8c67-3703ef4df37e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:45.976259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-87dd0211-2ab3-4147-8c67-3703ef4df37e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:45.977658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-bea308d1-b26a-4e91-897c-6d69aa559533 req-472b17e9-bca4-4aff-8479-609cbe8ed908 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:45.978291 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-bea308d1-b26a-4e91-897c-6d69aa559533 req-472b17e9-bca4-4aff-8479-609cbe8ed908 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:45.978721 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-bea308d1-b26a-4e91-897c-6d69aa559533 req-472b17e9-bca4-4aff-8479-609cbe8ed908 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:45.982647 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87dd0211-2ab3-4147-8c67-3703ef4df37e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:45.983215 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87dd0211-2ab3-4147-8c67-3703ef4df37e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:45.983837 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87dd0211-2ab3-4147-8c67-3703ef4df37e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:45.984591 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87dd0211-2ab3-4147-8c67-3703ef4df37e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:45.985051 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87dd0211-2ab3-4147-8c67-3703ef4df37e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:45.985476 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-87dd0211-2ab3-4147-8c67-3703ef4df37e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:45.990857 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-bea308d1-b26a-4e91-897c-6d69aa559533 req-472b17e9-bca4-4aff-8479-609cbe8ed908 service nova] Creating event network-vif-deleted:85b94151-961e-4568-b1f6-9b9ec1883e9a for instance 64544993-4d2e-4125-9371-c55b598a4ab1 on hv-cinder-85426 Aug 29 20:38:45.995866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-bea308d1-b26a-4e91-897c-6d69aa559533 req-472b17e9-bca4-4aff-8479-609cbe8ed908 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031826 Aug 29 20:38:45.996674 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 361/704] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:46.001467 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ed59ea47-7134-4845-8f63-ea2b38ca018a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] Calling method '.version_select at 0x7f48632eb4c0>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:46.021701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ed59ea47-7134-4845-8f63-ea2b38ca018a tempest-TestMinimumBasicScenario-771445608 tempest-TestMinimumBasicScenario-771445608-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2098198135" status: 202 len: 0 microversion: 2.1 time: 0.024074 Aug 29 20:38:46.022289 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 362/705] 10.222.0.18 () {58 vars in 1272 bytes} [Mon Aug 29 20:38:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2098198135 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:38:46.028007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-19ea5e8b-21ce-469f-b060-a130fda70fd8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:46.028416 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-19ea5e8b-21ce-469f-b060-a130fda70fd8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 64544993-4d2e-4125-9371-c55b598a4ab1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:46.034414 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-19ea5e8b-21ce-469f-b060-a130fda70fd8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:46.034909 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-19ea5e8b-21ce-469f-b060-a130fda70fd8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:46.035346 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-19ea5e8b-21ce-469f-b060-a130fda70fd8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:46.036075 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-19ea5e8b-21ce-469f-b060-a130fda70fd8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:46.036532 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-19ea5e8b-21ce-469f-b060-a130fda70fd8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:46.036958 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-19ea5e8b-21ce-469f-b060-a130fda70fd8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:46.052626 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-19ea5e8b-21ce-469f-b060-a130fda70fd8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] HTTP exception thrown: Instance 64544993-4d2e-4125-9371-c55b598a4ab1 could not be found. Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-19ea5e8b-21ce-469f-b060-a130fda70fd8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Request method failure captured: Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 HTTP/1.1 Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSJ-rwdl0t1Aj5l-1bGTIJFL-ZTxxAqt4Npmzg5SfQigz7qhWcnlSTLYkJ-kvIBMd62ylFVXsavpDA3ppxN3UCTRp7GeXqktCRuMiz1cX_UUXVeNdK0pTwdrrdVjfKv0odW_eu3KVvvRhEFMqiP8_f7uh50xlMra8Bbpcs0GLuMPJ8k Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 8436d85d931a41cfa6d626c08ad82ef4 Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:38:46.055169 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:38:46.058595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8436d85d931a41cfa6d626c08ad82ef4"}]}] Aug 29 20:38:46.058595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:38:46.058595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 8436d85d931a41cfa6d626c08ad82ef4 Aug 29 20:38:46.058595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:38:46.058595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-ServerRescueNegativeTestJSON-1627718934-project Aug 29 20:38:46.058595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:38:46.058595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:38:46.058595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 8fbc5bd64315421e97931402fb0e3a6a Aug 29 20:38:46.058595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1627718934-project Aug 29 20:38:46.058595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:38:46.058595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 64544993-4d2e-4125-9371-c55b598a4ab1 could not be found. Aug 29 20:38:46.058595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '64544993-4d2e-4125-9371-c55b598a4ab1'} Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64544993-4d2e-4125-9371-c55b598a4ab1 could not be found. Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:46.062427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64544993-4d2e-4125-9371-c55b598a4ab1 could not be found. Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64544993-4d2e-4125-9371-c55b598a4ab1 could not be found. Aug 29 20:38:46.066684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:46.070193 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-19ea5e8b-21ce-469f-b060-a130fda70fd8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Returning 404 to user: Instance 64544993-4d2e-4125-9371-c55b598a4ab1 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:46.070193 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-19ea5e8b-21ce-469f-b060-a130fda70fd8 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1" status: 404 len: 111 microversion: 2.1 time: 0.033398 Aug 29 20:38:46.070193 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 363/706] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:46 2022] GET /compute/v2.1/servers/64544993-4d2e-4125-9371-c55b598a4ab1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:46.070193 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4a05fb13-f484-48bc-bef4-cbddf9cc8d9a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '.version_select at 0x7f48631560d0>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:46.071473 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-87dd0211-2ab3-4147-8c67-3703ef4df37e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098793 Aug 29 20:38:46.071473 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 344/707] 10.222.0.18 () {60 vars in 1316 bytes} [Mon Aug 29 20:38:45 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:38:46.090180 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4a05fb13-f484-48bc-bef4-cbddf9cc8d9a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2146418515" status: 202 len: 0 microversion: 2.1 time: 0.028024 Aug 29 20:38:46.090767 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 364/708] 10.222.0.18 () {58 vars in 1221 bytes} [Mon Aug 29 20:38:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2146418515 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:38:46.992115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e79661f5-548d-4990-9026-254c8f14ea44 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:46.992810 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e79661f5-548d-4990-9026-254c8f14ea44 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:46.999268 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e79661f5-548d-4990-9026-254c8f14ea44 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:46.999843 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e79661f5-548d-4990-9026-254c8f14ea44 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:47.000434 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e79661f5-548d-4990-9026-254c8f14ea44 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:47.001358 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e79661f5-548d-4990-9026-254c8f14ea44 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:47.002009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e79661f5-548d-4990-9026-254c8f14ea44 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:47.002587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e79661f5-548d-4990-9026-254c8f14ea44 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:47.130157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-63cb8971-3643-4f17-b2e6-78d3a1411575 req-f77cf35d-a3b2-41f6-8939-2509112212a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8c3779-360e-43b6-8c43-50a3008159ea", "tag": "13477485-5060-4306-b273-b24627558f04"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:47.141245 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-63cb8971-3643-4f17-b2e6-78d3a1411575 req-f77cf35d-a3b2-41f6-8939-2509112212a3 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:47.141886 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-63cb8971-3643-4f17-b2e6-78d3a1411575 req-f77cf35d-a3b2-41f6-8939-2509112212a3 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:47.142442 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-63cb8971-3643-4f17-b2e6-78d3a1411575 req-f77cf35d-a3b2-41f6-8939-2509112212a3 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:47.155975 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-63cb8971-3643-4f17-b2e6-78d3a1411575 req-f77cf35d-a3b2-41f6-8939-2509112212a3 service nova] Creating event network-changed:13477485-5060-4306-b273-b24627558f04 for instance bb8c3779-360e-43b6-8c43-50a3008159ea on hv-cinder-85426 Aug 29 20:38:47.163367 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-63cb8971-3643-4f17-b2e6-78d3a1411575 req-f77cf35d-a3b2-41f6-8939-2509112212a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036400 Aug 29 20:38:47.164763 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 365/709] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:38:47.388051 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e79661f5-548d-4990-9026-254c8f14ea44 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:47.400693 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e79661f5-548d-4990-9026-254c8f14ea44 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.413251 Aug 29 20:38:47.415428 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 345/710] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:46 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:48.425770 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8a109f91-88e7-4ef5-86b2-b7562531e171 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:48.426797 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8a109f91-88e7-4ef5-86b2-b7562531e171 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:48.433441 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8a109f91-88e7-4ef5-86b2-b7562531e171 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:48.433935 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8a109f91-88e7-4ef5-86b2-b7562531e171 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:48.434376 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8a109f91-88e7-4ef5-86b2-b7562531e171 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:48.435091 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8a109f91-88e7-4ef5-86b2-b7562531e171 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:48.435804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8a109f91-88e7-4ef5-86b2-b7562531e171 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:48.436287 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8a109f91-88e7-4ef5-86b2-b7562531e171 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:48.576276 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8a109f91-88e7-4ef5-86b2-b7562531e171 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:48.584327 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8a109f91-88e7-4ef5-86b2-b7562531e171 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.163908 Aug 29 20:38:48.584899 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 366/711] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:48 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:49.606115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c3e9f2b3-8079-425a-8047-0b92d4cb4e60 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:49.607345 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c3e9f2b3-8079-425a-8047-0b92d4cb4e60 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:49.614206 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3e9f2b3-8079-425a-8047-0b92d4cb4e60 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:49.614635 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3e9f2b3-8079-425a-8047-0b92d4cb4e60 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:49.615247 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3e9f2b3-8079-425a-8047-0b92d4cb4e60 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:49.616158 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3e9f2b3-8079-425a-8047-0b92d4cb4e60 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:49.616770 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3e9f2b3-8079-425a-8047-0b92d4cb4e60 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:49.617361 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c3e9f2b3-8079-425a-8047-0b92d4cb4e60 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:49.828066 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c3e9f2b3-8079-425a-8047-0b92d4cb4e60 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:49.835902 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c3e9f2b3-8079-425a-8047-0b92d4cb4e60 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.234215 Aug 29 20:38:49.836475 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 346/712] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:49 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:49.989221 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-549e921b-c6dc-45ce-b7e6-52e0535ece1b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:49.989817 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-549e921b-c6dc-45ce-b7e6-52e0535ece1b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:49.996327 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-549e921b-c6dc-45ce-b7e6-52e0535ece1b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:49.996814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-549e921b-c6dc-45ce-b7e6-52e0535ece1b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:49.997250 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-549e921b-c6dc-45ce-b7e6-52e0535ece1b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:49.997954 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-549e921b-c6dc-45ce-b7e6-52e0535ece1b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:49.998434 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-549e921b-c6dc-45ce-b7e6-52e0535ece1b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:49.998860 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-549e921b-c6dc-45ce-b7e6-52e0535ece1b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:50.025380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-549e921b-c6dc-45ce-b7e6-52e0535ece1b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Going to try to terminate instance {{(pid=127027) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:38:50.106830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-549e921b-c6dc-45ce-b7e6-52e0535ece1b tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 204 len: 0 microversion: 2.1 time: 0.121054 Aug 29 20:38:50.107504 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 367/713] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:38:49 2022] DELETE /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:38:50.116149 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a6157d34-5bb2-4f48-8c22-5d80909ecfab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:50.117019 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a6157d34-5bb2-4f48-8c22-5d80909ecfab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:50.124025 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6157d34-5bb2-4f48-8c22-5d80909ecfab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:50.124812 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6157d34-5bb2-4f48-8c22-5d80909ecfab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:50.125443 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6157d34-5bb2-4f48-8c22-5d80909ecfab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:50.126714 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6157d34-5bb2-4f48-8c22-5d80909ecfab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:50.127644 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6157d34-5bb2-4f48-8c22-5d80909ecfab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:50.128138 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a6157d34-5bb2-4f48-8c22-5d80909ecfab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:50.377892 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a6157d34-5bb2-4f48-8c22-5d80909ecfab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:50.386214 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a6157d34-5bb2-4f48-8c22-5d80909ecfab tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1508 microversion: 2.1 time: 0.274377 Aug 29 20:38:50.386801 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 347/714] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:50 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:38:50.861069 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-0057a68f-113d-4cdc-b260-3bca7b3d9c28 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:50.861381 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-0057a68f-113d-4cdc-b260-3bca7b3d9c28 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:50.871747 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0057a68f-113d-4cdc-b260-3bca7b3d9c28 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:50.872324 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0057a68f-113d-4cdc-b260-3bca7b3d9c28 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:50.872829 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0057a68f-113d-4cdc-b260-3bca7b3d9c28 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:50.873848 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0057a68f-113d-4cdc-b260-3bca7b3d9c28 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:50.874387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0057a68f-113d-4cdc-b260-3bca7b3d9c28 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:50.875034 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0057a68f-113d-4cdc-b260-3bca7b3d9c28 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:50.892039 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:51.132762 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-0057a68f-113d-4cdc-b260-3bca7b3d9c28 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:51.153237 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-0057a68f-113d-4cdc-b260-3bca7b3d9c28 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.292116 Aug 29 20:38:51.164143 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 368/715] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:50 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:51.407901 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dfb0a8d6-2e24-44fa-bb50-f1c336e27f56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:51.408576 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dfb0a8d6-2e24-44fa-bb50-f1c336e27f56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:51.415130 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfb0a8d6-2e24-44fa-bb50-f1c336e27f56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:51.415607 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfb0a8d6-2e24-44fa-bb50-f1c336e27f56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:51.416073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfb0a8d6-2e24-44fa-bb50-f1c336e27f56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:51.416765 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfb0a8d6-2e24-44fa-bb50-f1c336e27f56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:51.417219 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfb0a8d6-2e24-44fa-bb50-f1c336e27f56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:51.417664 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-dfb0a8d6-2e24-44fa-bb50-f1c336e27f56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:51.643112 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-dfb0a8d6-2e24-44fa-bb50-f1c336e27f56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:51.650903 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dfb0a8d6-2e24-44fa-bb50-f1c336e27f56 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1508 microversion: 2.1 time: 0.248046 Aug 29 20:38:51.651711 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 348/716] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:51 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1508 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:52.171953 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2a3a47ba-542c-4c0e-8f3d-270f7cd710d9 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:52.173628 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2a3a47ba-542c-4c0e-8f3d-270f7cd710d9 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:52.180691 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2a3a47ba-542c-4c0e-8f3d-270f7cd710d9 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:52.181181 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2a3a47ba-542c-4c0e-8f3d-270f7cd710d9 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:52.181618 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2a3a47ba-542c-4c0e-8f3d-270f7cd710d9 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:52.182373 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2a3a47ba-542c-4c0e-8f3d-270f7cd710d9 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:52.182898 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2a3a47ba-542c-4c0e-8f3d-270f7cd710d9 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:52.183487 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2a3a47ba-542c-4c0e-8f3d-270f7cd710d9 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:52.334530 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2a3a47ba-542c-4c0e-8f3d-270f7cd710d9 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:52.342952 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2a3a47ba-542c-4c0e-8f3d-270f7cd710d9 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.176335 Aug 29 20:38:52.343529 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 369/717] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:52 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:52.671452 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0c019a43-4594-46ad-bcc0-358d52264e6a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:52.672086 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0c019a43-4594-46ad-bcc0-358d52264e6a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:52.678508 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c019a43-4594-46ad-bcc0-358d52264e6a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:52.678985 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c019a43-4594-46ad-bcc0-358d52264e6a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:52.679414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c019a43-4594-46ad-bcc0-358d52264e6a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:52.680128 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c019a43-4594-46ad-bcc0-358d52264e6a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:52.680576 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c019a43-4594-46ad-bcc0-358d52264e6a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:52.680997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0c019a43-4594-46ad-bcc0-358d52264e6a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:52.982842 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0c019a43-4594-46ad-bcc0-358d52264e6a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:52.991563 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0c019a43-4594-46ad-bcc0-358d52264e6a tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1508 microversion: 2.1 time: 0.323986 Aug 29 20:38:52.992178 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 349/718] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:52 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:53.272476 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-50846b18-9cd9-4da8-b6de-b6df8aea5b0f req-297ab687-f28a-4d6f-b4ee-6df8f816b16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc0cdac-77c6-4130-b162-e04f6a61c60c", "name": "network-vif-deleted", "tag": "d8d1277a-533e-438a-99e5-6a4962cfe90d"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:38:53.289479 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-50846b18-9cd9-4da8-b6de-b6df8aea5b0f req-297ab687-f28a-4d6f-b4ee-6df8f816b16b service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:53.289959 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-50846b18-9cd9-4da8-b6de-b6df8aea5b0f req-297ab687-f28a-4d6f-b4ee-6df8f816b16b service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:53.290390 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-50846b18-9cd9-4da8-b6de-b6df8aea5b0f req-297ab687-f28a-4d6f-b4ee-6df8f816b16b service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:53.313492 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-50846b18-9cd9-4da8-b6de-b6df8aea5b0f req-297ab687-f28a-4d6f-b4ee-6df8f816b16b service nova] Creating event network-vif-deleted:d8d1277a-533e-438a-99e5-6a4962cfe90d for instance 5dc0cdac-77c6-4130-b162-e04f6a61c60c on hv-cinder-85426 Aug 29 20:38:53.320100 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-50846b18-9cd9-4da8-b6de-b6df8aea5b0f req-297ab687-f28a-4d6f-b4ee-6df8f816b16b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052385 Aug 29 20:38:53.321267 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 370/719] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:38:53.365123 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-df042209-eb1c-4179-9d52-b1d09f2a3233 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:53.365927 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-df042209-eb1c-4179-9d52-b1d09f2a3233 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:53.373062 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df042209-eb1c-4179-9d52-b1d09f2a3233 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:53.374006 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df042209-eb1c-4179-9d52-b1d09f2a3233 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:53.374658 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df042209-eb1c-4179-9d52-b1d09f2a3233 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:53.375587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df042209-eb1c-4179-9d52-b1d09f2a3233 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:53.376300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df042209-eb1c-4179-9d52-b1d09f2a3233 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:53.376931 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-df042209-eb1c-4179-9d52-b1d09f2a3233 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:53.591024 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-df042209-eb1c-4179-9d52-b1d09f2a3233 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:53.600361 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-df042209-eb1c-4179-9d52-b1d09f2a3233 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.239120 Aug 29 20:38:53.615981 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 350/720] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:53 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:54.016036 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-57ead524-b5d1-4e1f-a0e5-b6e836982a54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:54.017816 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-57ead524-b5d1-4e1f-a0e5-b6e836982a54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:54.034313 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-57ead524-b5d1-4e1f-a0e5-b6e836982a54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:54.036116 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-57ead524-b5d1-4e1f-a0e5-b6e836982a54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:54.037053 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-57ead524-b5d1-4e1f-a0e5-b6e836982a54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:54.038119 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-57ead524-b5d1-4e1f-a0e5-b6e836982a54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:54.038720 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-57ead524-b5d1-4e1f-a0e5-b6e836982a54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:54.039512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-57ead524-b5d1-4e1f-a0e5-b6e836982a54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:54.095129 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-57ead524-b5d1-4e1f-a0e5-b6e836982a54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:54.095994 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-57ead524-b5d1-4e1f-a0e5-b6e836982a54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:54.096798 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-57ead524-b5d1-4e1f-a0e5-b6e836982a54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:54.097487 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-57ead524-b5d1-4e1f-a0e5-b6e836982a54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lazy-loading 'fault' on Instance uuid 5dc0cdac-77c6-4130-b162-e04f6a61c60c {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:38:54.165754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-57ead524-b5d1-4e1f-a0e5-b6e836982a54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:54.177299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-57ead524-b5d1-4e1f-a0e5-b6e836982a54 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 200 len: 1312 microversion: 2.1 time: 0.165539 Aug 29 20:38:54.178631 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 371/721] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:54 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:54.622830 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb74d694-a223-4e8f-98f2-1a6d18cc95ab tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:54.623438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb74d694-a223-4e8f-98f2-1a6d18cc95ab tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:54.630162 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb74d694-a223-4e8f-98f2-1a6d18cc95ab tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:54.630643 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb74d694-a223-4e8f-98f2-1a6d18cc95ab tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:54.631071 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb74d694-a223-4e8f-98f2-1a6d18cc95ab tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:54.631757 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb74d694-a223-4e8f-98f2-1a6d18cc95ab tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:54.632390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb74d694-a223-4e8f-98f2-1a6d18cc95ab tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:54.632808 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb74d694-a223-4e8f-98f2-1a6d18cc95ab tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:54.796877 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-eb74d694-a223-4e8f-98f2-1a6d18cc95ab tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:54.799182 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=100 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:54.807048 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb74d694-a223-4e8f-98f2-1a6d18cc95ab tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.188174 Aug 29 20:38:54.807624 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 351/722] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:54 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:55.203757 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f5f20aaf-68e6-4adb-a469-6a68c63f5c68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:55.204760 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-f5f20aaf-68e6-4adb-a469-6a68c63f5c68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 5dc0cdac-77c6-4130-b162-e04f6a61c60c] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:55.211856 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f5f20aaf-68e6-4adb-a469-6a68c63f5c68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:55.213026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f5f20aaf-68e6-4adb-a469-6a68c63f5c68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:55.213942 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f5f20aaf-68e6-4adb-a469-6a68c63f5c68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:55.215102 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f5f20aaf-68e6-4adb-a469-6a68c63f5c68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:55.215875 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f5f20aaf-68e6-4adb-a469-6a68c63f5c68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:55.216519 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-f5f20aaf-68e6-4adb-a469-6a68c63f5c68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:55.245473 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-f5f20aaf-68e6-4adb-a469-6a68c63f5c68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] HTTP exception thrown: Instance 5dc0cdac-77c6-4130-b162-e04f6a61c60c could not be found. Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f5f20aaf-68e6-4adb-a469-6a68c63f5c68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Request method failure captured: Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c HTTP/1.1 Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSJ-rwdl0t1Aj5l-1bGTIJFL-ZTxxAqt4Npmzg5SfQigz7qhWcnlSTLYkJ-kvIBMd62ylFVXsavpDA3ppxN3UCTRp7GeXqktCRuMiz1cX_UUXVeNdK0pTwdrrdVjfKv0odW_eu3KVvvRhEFMqiP8_f7uh50xlMra8Bbpcs0GLuMPJ8k Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 8436d85d931a41cfa6d626c08ad82ef4 Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:38:55.247205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:38:55.249439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8436d85d931a41cfa6d626c08ad82ef4"}]}] Aug 29 20:38:55.249439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:38:55.249439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 8436d85d931a41cfa6d626c08ad82ef4 Aug 29 20:38:55.249439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:38:55.249439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-ServerRescueNegativeTestJSON-1627718934-project Aug 29 20:38:55.249439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:38:55.249439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:38:55.249439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 8fbc5bd64315421e97931402fb0e3a6a Aug 29 20:38:55.249439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1627718934-project Aug 29 20:38:55.249439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:38:55.249439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 5dc0cdac-77c6-4130-b162-e04f6a61c60c could not be found. Aug 29 20:38:55.249439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '5dc0cdac-77c6-4130-b162-e04f6a61c60c'} Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dc0cdac-77c6-4130-b162-e04f6a61c60c could not be found. Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:38:55.254550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dc0cdac-77c6-4130-b162-e04f6a61c60c could not be found. Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dc0cdac-77c6-4130-b162-e04f6a61c60c could not be found. Aug 29 20:38:55.256782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:38:55.258674 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f5f20aaf-68e6-4adb-a469-6a68c63f5c68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Returning 404 to user: Instance 5dc0cdac-77c6-4130-b162-e04f6a61c60c could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:38:55.258674 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-f5f20aaf-68e6-4adb-a469-6a68c63f5c68 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c" status: 404 len: 111 microversion: 2.1 time: 0.051360 Aug 29 20:38:55.258674 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 372/723] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:55 2022] GET /compute/v2.1/servers/5dc0cdac-77c6-4130-b162-e04f6a61c60c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:55.266467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-79a0f7c1-2fbe-4df4-8ce4-5a202f9195b1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:55.266973 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-79a0f7c1-2fbe-4df4-8ce4-5a202f9195b1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:55.273779 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79a0f7c1-2fbe-4df4-8ce4-5a202f9195b1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:55.274267 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79a0f7c1-2fbe-4df4-8ce4-5a202f9195b1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:55.275067 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79a0f7c1-2fbe-4df4-8ce4-5a202f9195b1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:55.275406 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79a0f7c1-2fbe-4df4-8ce4-5a202f9195b1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:55.275828 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79a0f7c1-2fbe-4df4-8ce4-5a202f9195b1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:55.276283 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-79a0f7c1-2fbe-4df4-8ce4-5a202f9195b1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:55.304113 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-79a0f7c1-2fbe-4df4-8ce4-5a202f9195b1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:38:55.425636 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:55.432803 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-79a0f7c1-2fbe-4df4-8ce4-5a202f9195b1 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 204 len: 0 microversion: 2.1 time: 0.168720 Aug 29 20:38:55.433700 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 352/724] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:38:55 2022] DELETE /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:38:55.443114 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ce26e591-b0e7-43ba-ac76-0400ff1d1fc2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:55.444230 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ce26e591-b0e7-43ba-ac76-0400ff1d1fc2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:55.451829 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ce26e591-b0e7-43ba-ac76-0400ff1d1fc2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:55.452613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ce26e591-b0e7-43ba-ac76-0400ff1d1fc2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:55.453224 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ce26e591-b0e7-43ba-ac76-0400ff1d1fc2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:55.454197 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ce26e591-b0e7-43ba-ac76-0400ff1d1fc2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:55.454588 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ce26e591-b0e7-43ba-ac76-0400ff1d1fc2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:55.455188 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ce26e591-b0e7-43ba-ac76-0400ff1d1fc2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:55.604327 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-ce26e591-b0e7-43ba-ac76-0400ff1d1fc2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:55.615109 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ce26e591-b0e7-43ba-ac76-0400ff1d1fc2 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.175773 Aug 29 20:38:55.615694 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 373/725] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:55 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:55.829927 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eadb4604-0b7d-42a0-af7b-f79a4caa5745 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:55.830643 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eadb4604-0b7d-42a0-af7b-f79a4caa5745 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:55.837392 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eadb4604-0b7d-42a0-af7b-f79a4caa5745 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:55.837936 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eadb4604-0b7d-42a0-af7b-f79a4caa5745 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:55.838415 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eadb4604-0b7d-42a0-af7b-f79a4caa5745 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:55.839120 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eadb4604-0b7d-42a0-af7b-f79a4caa5745 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:55.839577 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eadb4604-0b7d-42a0-af7b-f79a4caa5745 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:55.840032 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eadb4604-0b7d-42a0-af7b-f79a4caa5745 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:55.985967 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-eadb4604-0b7d-42a0-af7b-f79a4caa5745 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:55.993862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eadb4604-0b7d-42a0-af7b-f79a4caa5745 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.169307 Aug 29 20:38:55.994433 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 353/726] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:55 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:56.636913 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1ab7799c-18ff-41dc-bc8c-485ce163d13f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:56.637762 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1ab7799c-18ff-41dc-bc8c-485ce163d13f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:56.644851 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1ab7799c-18ff-41dc-bc8c-485ce163d13f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:56.645336 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1ab7799c-18ff-41dc-bc8c-485ce163d13f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:56.645768 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1ab7799c-18ff-41dc-bc8c-485ce163d13f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:56.646473 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1ab7799c-18ff-41dc-bc8c-485ce163d13f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:56.646926 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1ab7799c-18ff-41dc-bc8c-485ce163d13f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:56.647375 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1ab7799c-18ff-41dc-bc8c-485ce163d13f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:56.790155 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1ab7799c-18ff-41dc-bc8c-485ce163d13f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:56.798239 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1ab7799c-18ff-41dc-bc8c-485ce163d13f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.166137 Aug 29 20:38:56.798797 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 374/727] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:56 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:57.017563 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8247fdd9-25f3-4ff6-914e-592310a76e66 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:57.018111 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8247fdd9-25f3-4ff6-914e-592310a76e66 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:57.025140 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8247fdd9-25f3-4ff6-914e-592310a76e66 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:57.025630 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8247fdd9-25f3-4ff6-914e-592310a76e66 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:57.026070 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8247fdd9-25f3-4ff6-914e-592310a76e66 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:57.026777 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8247fdd9-25f3-4ff6-914e-592310a76e66 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:57.027234 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8247fdd9-25f3-4ff6-914e-592310a76e66 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:57.027659 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8247fdd9-25f3-4ff6-914e-592310a76e66 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:57.168550 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8247fdd9-25f3-4ff6-914e-592310a76e66 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:57.176570 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8247fdd9-25f3-4ff6-914e-592310a76e66 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.162913 Aug 29 20:38:57.177048 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 354/728] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:57 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:57.819964 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-99dcd2b0-88b1-40cc-b293-f95285fb5751 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:57.820674 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-99dcd2b0-88b1-40cc-b293-f95285fb5751 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:57.827973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-99dcd2b0-88b1-40cc-b293-f95285fb5751 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:57.828465 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-99dcd2b0-88b1-40cc-b293-f95285fb5751 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:57.828898 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-99dcd2b0-88b1-40cc-b293-f95285fb5751 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:57.829604 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-99dcd2b0-88b1-40cc-b293-f95285fb5751 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:57.830051 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-99dcd2b0-88b1-40cc-b293-f95285fb5751 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:57.830474 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-99dcd2b0-88b1-40cc-b293-f95285fb5751 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:57.971773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-99dcd2b0-88b1-40cc-b293-f95285fb5751 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:57.980261 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-99dcd2b0-88b1-40cc-b293-f95285fb5751 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.164115 Aug 29 20:38:57.980823 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 375/729] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:57 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:58.199230 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-07f39b38-5e8d-4b3e-b032-b0a1bd866f9b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:58.199896 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-07f39b38-5e8d-4b3e-b032-b0a1bd866f9b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:58.206846 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07f39b38-5e8d-4b3e-b032-b0a1bd866f9b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:58.207328 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07f39b38-5e8d-4b3e-b032-b0a1bd866f9b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:58.207763 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07f39b38-5e8d-4b3e-b032-b0a1bd866f9b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:58.208496 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07f39b38-5e8d-4b3e-b032-b0a1bd866f9b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:58.208945 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07f39b38-5e8d-4b3e-b032-b0a1bd866f9b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:58.209907 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-0b8317b0-fc66-4940-9e9f-abad2ecc5b7e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:58.210028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07f39b38-5e8d-4b3e-b032-b0a1bd866f9b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:58.210136 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-0b8317b0-fc66-4940-9e9f-abad2ecc5b7e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:58.216183 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0b8317b0-fc66-4940-9e9f-abad2ecc5b7e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:58.216747 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0b8317b0-fc66-4940-9e9f-abad2ecc5b7e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:58.217271 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0b8317b0-fc66-4940-9e9f-abad2ecc5b7e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:58.217961 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0b8317b0-fc66-4940-9e9f-abad2ecc5b7e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:58.218408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0b8317b0-fc66-4940-9e9f-abad2ecc5b7e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:58.218824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0b8317b0-fc66-4940-9e9f-abad2ecc5b7e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:58.243460 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-0b8317b0-fc66-4940-9e9f-abad2ecc5b7e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Going to try to terminate instance {{(pid=127027) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:38:58.339502 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-0b8317b0-fc66-4940-9e9f-abad2ecc5b7e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 204 len: 0 microversion: 2.1 time: 0.134023 Aug 29 20:38:58.340306 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 376/730] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:38:58 2022] DELETE /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:38:58.349754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8c23f1e7-0434-4872-99bc-df5b55935e2e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:58.350611 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8c23f1e7-0434-4872-99bc-df5b55935e2e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:58.357383 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c23f1e7-0434-4872-99bc-df5b55935e2e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:58.358233 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c23f1e7-0434-4872-99bc-df5b55935e2e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:58.358885 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c23f1e7-0434-4872-99bc-df5b55935e2e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:58.359782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c23f1e7-0434-4872-99bc-df5b55935e2e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:58.360509 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c23f1e7-0434-4872-99bc-df5b55935e2e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:58.361881 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c23f1e7-0434-4872-99bc-df5b55935e2e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:58.442681 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-07f39b38-5e8d-4b3e-b032-b0a1bd866f9b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:58.451991 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-07f39b38-5e8d-4b3e-b032-b0a1bd866f9b tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.257066 Aug 29 20:38:58.462617 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 355/731] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:58 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:58.527286 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8c23f1e7-0434-4872-99bc-df5b55935e2e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:58.535232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8c23f1e7-0434-4872-99bc-df5b55935e2e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1576 microversion: 2.1 time: 0.189909 Aug 29 20:38:58.535805 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 377/732] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:58 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:59.003479 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-447f57a0-143f-4c7a-b538-a2fdf37f9787 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:59.004375 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-447f57a0-143f-4c7a-b538-a2fdf37f9787 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:59.012056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-447f57a0-143f-4c7a-b538-a2fdf37f9787 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:59.012628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-447f57a0-143f-4c7a-b538-a2fdf37f9787 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:59.013150 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-447f57a0-143f-4c7a-b538-a2fdf37f9787 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:59.014009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-447f57a0-143f-4c7a-b538-a2fdf37f9787 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:59.014472 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-447f57a0-143f-4c7a-b538-a2fdf37f9787 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:59.014999 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-447f57a0-143f-4c7a-b538-a2fdf37f9787 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:59.156254 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-447f57a0-143f-4c7a-b538-a2fdf37f9787 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:59.163912 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-447f57a0-143f-4c7a-b538-a2fdf37f9787 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1522 microversion: 2.1 time: 0.165634 Aug 29 20:38:59.164493 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 356/733] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:58 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:38:59.473284 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-de39106e-5dbb-43cd-b84b-73a6cc9e0161 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:59.473923 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-de39106e-5dbb-43cd-b84b-73a6cc9e0161 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:59.480370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-de39106e-5dbb-43cd-b84b-73a6cc9e0161 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:59.480847 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-de39106e-5dbb-43cd-b84b-73a6cc9e0161 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:59.481277 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-de39106e-5dbb-43cd-b84b-73a6cc9e0161 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:59.481968 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-de39106e-5dbb-43cd-b84b-73a6cc9e0161 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:59.482417 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-de39106e-5dbb-43cd-b84b-73a6cc9e0161 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:59.482838 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-de39106e-5dbb-43cd-b84b-73a6cc9e0161 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:59.556293 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e1ce4ac1-ca08-4062-a4b6-5ea591529753 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:38:59.556903 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e1ce4ac1-ca08-4062-a4b6-5ea591529753 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:38:59.563667 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1ce4ac1-ca08-4062-a4b6-5ea591529753 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:59.564124 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1ce4ac1-ca08-4062-a4b6-5ea591529753 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:59.564713 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1ce4ac1-ca08-4062-a4b6-5ea591529753 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:59.565247 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1ce4ac1-ca08-4062-a4b6-5ea591529753 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:38:59.566347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1ce4ac1-ca08-4062-a4b6-5ea591529753 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:38:59.566784 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e1ce4ac1-ca08-4062-a4b6-5ea591529753 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:38:59.620345 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-de39106e-5dbb-43cd-b84b-73a6cc9e0161 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:59.628342 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-de39106e-5dbb-43cd-b84b-73a6cc9e0161 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.158880 Aug 29 20:38:59.628911 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 378/734] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:59 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:38:59.825592 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e1ce4ac1-ca08-4062-a4b6-5ea591529753 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:38:59.835119 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e1ce4ac1-ca08-4062-a4b6-5ea591529753 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1576 microversion: 2.1 time: 0.282552 Aug 29 20:38:59.835786 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 357/735] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:38:59 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1576 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:39:00.186518 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7184cfde-823e-44ac-8542-5bd698a421cf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:00.187160 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7184cfde-823e-44ac-8542-5bd698a421cf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:00.194379 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7184cfde-823e-44ac-8542-5bd698a421cf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:00.194868 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7184cfde-823e-44ac-8542-5bd698a421cf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:00.195308 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7184cfde-823e-44ac-8542-5bd698a421cf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:00.196040 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7184cfde-823e-44ac-8542-5bd698a421cf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:00.197288 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7184cfde-823e-44ac-8542-5bd698a421cf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:00.198086 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7184cfde-823e-44ac-8542-5bd698a421cf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:00.241484 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-08598ae8-9fc7-4c52-93b9-be1768c7f7f4 req-0a28c24d-dbb5-450f-aac7-48bd54069cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db93852-3c79-43ac-8757-a41602e8bc53", "name": "network-vif-deleted", "tag": "83aab753-4372-4b2f-a578-8ecea2f99be1"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:39:00.252354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-08598ae8-9fc7-4c52-93b9-be1768c7f7f4 req-0a28c24d-dbb5-450f-aac7-48bd54069cee service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:00.252835 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-08598ae8-9fc7-4c52-93b9-be1768c7f7f4 req-0a28c24d-dbb5-450f-aac7-48bd54069cee service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:00.253465 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-08598ae8-9fc7-4c52-93b9-be1768c7f7f4 req-0a28c24d-dbb5-450f-aac7-48bd54069cee service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:00.264739 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-08598ae8-9fc7-4c52-93b9-be1768c7f7f4 req-0a28c24d-dbb5-450f-aac7-48bd54069cee service nova] Creating event network-vif-deleted:83aab753-4372-4b2f-a578-8ecea2f99be1 for instance 3db93852-3c79-43ac-8757-a41602e8bc53 on hv-cinder-85426 Aug 29 20:39:00.269602 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-08598ae8-9fc7-4c52-93b9-be1768c7f7f4 req-0a28c24d-dbb5-450f-aac7-48bd54069cee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032103 Aug 29 20:39:00.270196 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 358/736] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:39:00.276810 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7184cfde-823e-44ac-8542-5bd698a421cf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:00.284806 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7184cfde-823e-44ac-8542-5bd698a421cf tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1480 microversion: 2.1 time: 0.103057 Aug 29 20:39:00.285384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 379/737] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:00 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1480 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:00.659420 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b61e8667-7fa7-4588-a17a-6f5f76d29ffd tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:00.661008 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b61e8667-7fa7-4588-a17a-6f5f76d29ffd tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:00.668039 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b61e8667-7fa7-4588-a17a-6f5f76d29ffd tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:00.668930 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b61e8667-7fa7-4588-a17a-6f5f76d29ffd tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:00.669548 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b61e8667-7fa7-4588-a17a-6f5f76d29ffd tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:00.670639 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b61e8667-7fa7-4588-a17a-6f5f76d29ffd tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:00.671102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b61e8667-7fa7-4588-a17a-6f5f76d29ffd tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:00.671530 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b61e8667-7fa7-4588-a17a-6f5f76d29ffd tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:00.841646 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-b61e8667-7fa7-4588-a17a-6f5f76d29ffd tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:00.849662 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b61e8667-7fa7-4588-a17a-6f5f76d29ffd tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.195090 Aug 29 20:39:00.850236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 359/738] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:00 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:00.857808 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e112bdd5-8ae1-4912-a65e-fc8a232f1939 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:00.858556 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e112bdd5-8ae1-4912-a65e-fc8a232f1939 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:00.861445 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:00.866981 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e112bdd5-8ae1-4912-a65e-fc8a232f1939 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:00.867566 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e112bdd5-8ae1-4912-a65e-fc8a232f1939 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:00.868105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e112bdd5-8ae1-4912-a65e-fc8a232f1939 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:00.868869 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e112bdd5-8ae1-4912-a65e-fc8a232f1939 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:00.869938 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e112bdd5-8ae1-4912-a65e-fc8a232f1939 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:00.870425 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e112bdd5-8ae1-4912-a65e-fc8a232f1939 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:01.072214 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e112bdd5-8ae1-4912-a65e-fc8a232f1939 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:01.080246 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e112bdd5-8ae1-4912-a65e-fc8a232f1939 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1576 microversion: 2.1 time: 0.226700 Aug 29 20:39:01.080920 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 380/739] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:00 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:01.307822 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8b218c27-39a5-4de0-9e5e-d7c7267e532d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:01.308470 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8b218c27-39a5-4de0-9e5e-d7c7267e532d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:01.314680 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b218c27-39a5-4de0-9e5e-d7c7267e532d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:01.315175 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b218c27-39a5-4de0-9e5e-d7c7267e532d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:01.315614 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b218c27-39a5-4de0-9e5e-d7c7267e532d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:01.316536 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b218c27-39a5-4de0-9e5e-d7c7267e532d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:01.316995 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b218c27-39a5-4de0-9e5e-d7c7267e532d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:01.317434 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b218c27-39a5-4de0-9e5e-d7c7267e532d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:01.349919 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b218c27-39a5-4de0-9e5e-d7c7267e532d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:01.350402 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b218c27-39a5-4de0-9e5e-d7c7267e532d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:01.350835 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8b218c27-39a5-4de0-9e5e-d7c7267e532d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:01.351280 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-8b218c27-39a5-4de0-9e5e-d7c7267e532d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lazy-loading 'fault' on Instance uuid 3db93852-3c79-43ac-8757-a41602e8bc53 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:39:01.392502 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8b218c27-39a5-4de0-9e5e-d7c7267e532d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:01.400721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8b218c27-39a5-4de0-9e5e-d7c7267e532d tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1312 microversion: 2.1 time: 0.097473 Aug 29 20:39:01.401286 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 360/740] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:01 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:01.484272 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-f4331e68-2d14-4df2-9444-59fdad6f8366 req-740f469d-6f35-4b31-8c22-ce21c895544f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1773df51-c30e-4b2d-8497-eb95021c3efa", "name": "network-vif-deleted", "tag": "236dc660-6b61-4948-8380-7bb59931ce55"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:39:01.493583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-f4331e68-2d14-4df2-9444-59fdad6f8366 req-740f469d-6f35-4b31-8c22-ce21c895544f service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:01.494098 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-f4331e68-2d14-4df2-9444-59fdad6f8366 req-740f469d-6f35-4b31-8c22-ce21c895544f service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:01.494521 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-f4331e68-2d14-4df2-9444-59fdad6f8366 req-740f469d-6f35-4b31-8c22-ce21c895544f service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:01.507612 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-f4331e68-2d14-4df2-9444-59fdad6f8366 req-740f469d-6f35-4b31-8c22-ce21c895544f service nova] Creating event network-vif-deleted:236dc660-6b61-4948-8380-7bb59931ce55 for instance 1773df51-c30e-4b2d-8497-eb95021c3efa on hv-cinder-85426 Aug 29 20:39:01.513317 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-f4331e68-2d14-4df2-9444-59fdad6f8366 req-740f469d-6f35-4b31-8c22-ce21c895544f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032619 Aug 29 20:39:01.516911 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 381/741] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:39:01.872045 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9e4cf841-afb8-4e93-ad9b-a3a5e3826411 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:01.872678 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9e4cf841-afb8-4e93-ad9b-a3a5e3826411 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:01.879777 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e4cf841-afb8-4e93-ad9b-a3a5e3826411 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:01.880349 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e4cf841-afb8-4e93-ad9b-a3a5e3826411 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:01.880789 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e4cf841-afb8-4e93-ad9b-a3a5e3826411 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:01.881510 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e4cf841-afb8-4e93-ad9b-a3a5e3826411 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:01.881969 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e4cf841-afb8-4e93-ad9b-a3a5e3826411 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:01.882391 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9e4cf841-afb8-4e93-ad9b-a3a5e3826411 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:02.024117 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-9e4cf841-afb8-4e93-ad9b-a3a5e3826411 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:02.032162 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9e4cf841-afb8-4e93-ad9b-a3a5e3826411 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.164602 Aug 29 20:39:02.032837 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 361/742] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:01 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:02.102925 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b8b551ce-02c7-4215-9750-9e86e0522526 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:02.103710 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b8b551ce-02c7-4215-9750-9e86e0522526 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:02.110019 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b8b551ce-02c7-4215-9750-9e86e0522526 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:02.110501 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b8b551ce-02c7-4215-9750-9e86e0522526 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:02.110943 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b8b551ce-02c7-4215-9750-9e86e0522526 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:02.111725 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b8b551ce-02c7-4215-9750-9e86e0522526 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:02.112216 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b8b551ce-02c7-4215-9750-9e86e0522526 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:02.112641 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b8b551ce-02c7-4215-9750-9e86e0522526 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:02.175432 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b8b551ce-02c7-4215-9750-9e86e0522526 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:02.183903 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b8b551ce-02c7-4215-9750-9e86e0522526 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1509 microversion: 2.1 time: 0.085947 Aug 29 20:39:02.184506 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 382/743] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:02 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1509 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:39:02.421484 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-21d3d0eb-de5e-40de-855a-2aa261f897f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:02.422209 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-21d3d0eb-de5e-40de-855a-2aa261f897f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:02.428585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d3d0eb-de5e-40de-855a-2aa261f897f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:02.429075 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d3d0eb-de5e-40de-855a-2aa261f897f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:02.429510 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d3d0eb-de5e-40de-855a-2aa261f897f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:02.430225 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d3d0eb-de5e-40de-855a-2aa261f897f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:02.430679 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d3d0eb-de5e-40de-855a-2aa261f897f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:02.431106 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d3d0eb-de5e-40de-855a-2aa261f897f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:02.468723 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d3d0eb-de5e-40de-855a-2aa261f897f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:02.469228 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d3d0eb-de5e-40de-855a-2aa261f897f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:02.469665 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-21d3d0eb-de5e-40de-855a-2aa261f897f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:02.470113 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-21d3d0eb-de5e-40de-855a-2aa261f897f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lazy-loading 'fault' on Instance uuid 3db93852-3c79-43ac-8757-a41602e8bc53 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:39:02.523914 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-21d3d0eb-de5e-40de-855a-2aa261f897f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fbc5bd64315421e97931402fb0e3a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436d85d931a41cfa6d626c08ad82ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:02.532218 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-21d3d0eb-de5e-40de-855a-2aa261f897f5 tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 200 len: 1312 microversion: 2.1 time: 0.114570 Aug 29 20:39:02.532794 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 362/744] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:02 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:03.053481 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a95885d1-7fcb-4736-b930-518647f3b3fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:03.054064 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a95885d1-7fcb-4736-b930-518647f3b3fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:03.060779 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a95885d1-7fcb-4736-b930-518647f3b3fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:03.061553 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a95885d1-7fcb-4736-b930-518647f3b3fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:03.062208 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a95885d1-7fcb-4736-b930-518647f3b3fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:03.063286 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a95885d1-7fcb-4736-b930-518647f3b3fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:03.064054 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a95885d1-7fcb-4736-b930-518647f3b3fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:03.064664 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a95885d1-7fcb-4736-b930-518647f3b3fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:03.204023 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a95885d1-7fcb-4736-b930-518647f3b3fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:03.205111 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ce6c23d-47b3-45d1-b9e7-7e4bbc1acc1f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:03.205727 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ce6c23d-47b3-45d1-b9e7-7e4bbc1acc1f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:03.213420 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6c23d-47b3-45d1-b9e7-7e4bbc1acc1f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:03.213667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a95885d1-7fcb-4736-b930-518647f3b3fa tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.163399 Aug 29 20:39:03.214221 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 383/745] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:03 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:03.214479 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6c23d-47b3-45d1-b9e7-7e4bbc1acc1f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:03.214929 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6c23d-47b3-45d1-b9e7-7e4bbc1acc1f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:03.215704 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6c23d-47b3-45d1-b9e7-7e4bbc1acc1f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:03.216346 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6c23d-47b3-45d1-b9e7-7e4bbc1acc1f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:03.216715 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6c23d-47b3-45d1-b9e7-7e4bbc1acc1f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:03.252442 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6c23d-47b3-45d1-b9e7-7e4bbc1acc1f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:03.252932 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6c23d-47b3-45d1-b9e7-7e4bbc1acc1f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:03.253369 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ce6c23d-47b3-45d1-b9e7-7e4bbc1acc1f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:03.254030 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-8ce6c23d-47b3-45d1-b9e7-7e4bbc1acc1f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lazy-loading 'fault' on Instance uuid 1773df51-c30e-4b2d-8497-eb95021c3efa {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:39:03.311679 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ce6c23d-47b3-45d1-b9e7-7e4bbc1acc1f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:03.321891 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ce6c23d-47b3-45d1-b9e7-7e4bbc1acc1f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 200 len: 1231 microversion: 2.1 time: 0.120679 Aug 29 20:39:03.336233 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 363/746] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:03 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 1231 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:39:03.554169 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9a091bc7-7ea7-448e-ab71-e361b153241f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:03.554813 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9a091bc7-7ea7-448e-ab71-e361b153241f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] [instance: 3db93852-3c79-43ac-8757-a41602e8bc53] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:03.562633 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a091bc7-7ea7-448e-ab71-e361b153241f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:03.563130 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a091bc7-7ea7-448e-ab71-e361b153241f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:03.563565 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a091bc7-7ea7-448e-ab71-e361b153241f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:03.564313 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a091bc7-7ea7-448e-ab71-e361b153241f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:03.564770 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a091bc7-7ea7-448e-ab71-e361b153241f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:03.565193 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9a091bc7-7ea7-448e-ab71-e361b153241f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:03.566565 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-29bdc061-316c-40f7-8fbf-2c50165ba047 req-89b138d9-a552-4c5d-a0dd-af762098dcfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36516f8-3de4-45fa-a124-83436dcfe1c1", "name": "network-vif-unplugged", "status": "completed", "tag": "8ff3928a-585f-4fdd-9895-afd0c54f0e08"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:39:03.576922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-29bdc061-316c-40f7-8fbf-2c50165ba047 req-89b138d9-a552-4c5d-a0dd-af762098dcfb service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:03.577399 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-29bdc061-316c-40f7-8fbf-2c50165ba047 req-89b138d9-a552-4c5d-a0dd-af762098dcfb service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:03.577839 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-29bdc061-316c-40f7-8fbf-2c50165ba047 req-89b138d9-a552-4c5d-a0dd-af762098dcfb service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:03.580348 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-9a091bc7-7ea7-448e-ab71-e361b153241f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] HTTP exception thrown: Instance 3db93852-3c79-43ac-8757-a41602e8bc53 could not be found. Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9a091bc7-7ea7-448e-ab71-e361b153241f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Request method failure captured: Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 HTTP/1.1 Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJ-rwdl0t1Aj5l-1bGTIJFL-ZTxxAqt4Npmzg5SfQigz7qhWcnlSTLYkJ-kvIBMd62ylFVXsavpDA3ppxN3UCTRp7GeXqktCRuMiz1cX_UUXVeNdK0pTwdrrdVjfKv0odW_eu3KVvvRhEFMqiP8_f7uh50xlMra8Bbpcs0GLuMPJ8k Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 8436d85d931a41cfa6d626c08ad82ef4 Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:39:03.582001 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:39:03.583541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8436d85d931a41cfa6d626c08ad82ef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8436d85d931a41cfa6d626c08ad82ef4"}]}] Aug 29 20:39:03.583541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:39:03.583541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 8436d85d931a41cfa6d626c08ad82ef4 Aug 29 20:39:03.583541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1627718934 Aug 29 20:39:03.583541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-ServerRescueNegativeTestJSON-1627718934-project Aug 29 20:39:03.583541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:39:03.583541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:39:03.583541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 8fbc5bd64315421e97931402fb0e3a6a Aug 29 20:39:03.583541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1627718934-project Aug 29 20:39:03.583541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:39:03.583541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance 3db93852-3c79-43ac-8757-a41602e8bc53 could not be found. Aug 29 20:39:03.583541 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '3db93852-3c79-43ac-8757-a41602e8bc53'} Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db93852-3c79-43ac-8757-a41602e8bc53 could not be found. Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:39:03.584467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db93852-3c79-43ac-8757-a41602e8bc53 could not be found. Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db93852-3c79-43ac-8757-a41602e8bc53 could not be found. Aug 29 20:39:03.585871 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:03.587155 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9a091bc7-7ea7-448e-ab71-e361b153241f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] Returning 404 to user: Instance 3db93852-3c79-43ac-8757-a41602e8bc53 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:39:03.587155 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9a091bc7-7ea7-448e-ab71-e361b153241f tempest-ServerRescueNegativeTestJSON-1627718934 tempest-ServerRescueNegativeTestJSON-1627718934-project] 10.222.0.18 "GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53" status: 404 len: 111 microversion: 2.1 time: 0.033297 Aug 29 20:39:03.587593 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 364/747] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:03 2022] GET /compute/v2.1/servers/3db93852-3c79-43ac-8757-a41602e8bc53 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:39:03.597775 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-29bdc061-316c-40f7-8fbf-2c50165ba047 req-89b138d9-a552-4c5d-a0dd-af762098dcfb service nova] Creating event network-vif-unplugged:8ff3928a-585f-4fdd-9895-afd0c54f0e08 for instance f36516f8-3de4-45fa-a124-83436dcfe1c1 on hv-cinder-85426 Aug 29 20:39:03.602745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-29bdc061-316c-40f7-8fbf-2c50165ba047 req-89b138d9-a552-4c5d-a0dd-af762098dcfb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.265345 Aug 29 20:39:03.603364 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 384/748] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:39:03.856421 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1422314d-4d6f-427b-b8e9-b2c85ba7daa6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:03.857000 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1422314d-4d6f-427b-b8e9-b2c85ba7daa6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:03.863017 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1422314d-4d6f-427b-b8e9-b2c85ba7daa6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:03.863513 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1422314d-4d6f-427b-b8e9-b2c85ba7daa6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:03.863971 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1422314d-4d6f-427b-b8e9-b2c85ba7daa6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:03.864683 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1422314d-4d6f-427b-b8e9-b2c85ba7daa6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:03.865134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1422314d-4d6f-427b-b8e9-b2c85ba7daa6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:03.866051 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1422314d-4d6f-427b-b8e9-b2c85ba7daa6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:03.891415 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1422314d-4d6f-427b-b8e9-b2c85ba7daa6 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/ips" status: 200 len: 147 microversion: 2.1 time: 0.039373 Aug 29 20:39:03.908038 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 365/749] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 29 20:39:03 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/ips => generated 147 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:39:04.236703 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7d9a39aa-7398-4ff2-a6fb-8e1929e7865c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:04.238007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7d9a39aa-7398-4ff2-a6fb-8e1929e7865c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:04.244121 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d9a39aa-7398-4ff2-a6fb-8e1929e7865c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:04.244917 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d9a39aa-7398-4ff2-a6fb-8e1929e7865c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:04.245359 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d9a39aa-7398-4ff2-a6fb-8e1929e7865c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:04.246105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d9a39aa-7398-4ff2-a6fb-8e1929e7865c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:04.246731 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d9a39aa-7398-4ff2-a6fb-8e1929e7865c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:04.247277 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d9a39aa-7398-4ff2-a6fb-8e1929e7865c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:04.344672 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d63a9476-4967-4942-94ec-e5fed57904ae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:04.346332 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d63a9476-4967-4942-94ec-e5fed57904ae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:04.353461 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d63a9476-4967-4942-94ec-e5fed57904ae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:04.354222 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d63a9476-4967-4942-94ec-e5fed57904ae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:04.355096 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d63a9476-4967-4942-94ec-e5fed57904ae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:04.355528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d63a9476-4967-4942-94ec-e5fed57904ae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:04.356154 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d63a9476-4967-4942-94ec-e5fed57904ae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:04.356651 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d63a9476-4967-4942-94ec-e5fed57904ae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:04.373742 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d63a9476-4967-4942-94ec-e5fed57904ae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] HTTP exception thrown: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d63a9476-4967-4942-94ec-e5fed57904ae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Request method failure captured: Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa HTTP/1.1 Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSMYSVxW64nkLA8P_N2v2aoN6lTYVB5Un09vohqhSYYTSp-arzNka2pLHEI4EPsPgr_eNyw8PTiLEuyOgon_FBhgCJDSd9B7G9lc33quZ-AyW_EJD8RtAvJI0G0BYsGOElz4-5K4Q0vr180Z2fsBfZi6gH89JAnueulO7Gwo90NmUU8 Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 4ac573b4aa7a47c49d129afd9939e26d Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-TestVolumeBootPattern-717289528 Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:39:04.375306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:39:04.377028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4ac573b4aa7a47c49d129afd9939e26d"}]}] Aug 29 20:39:04.377028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-TestVolumeBootPattern-717289528 Aug 29 20:39:04.377028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 4ac573b4aa7a47c49d129afd9939e26d Aug 29 20:39:04.377028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestVolumeBootPattern-717289528 Aug 29 20:39:04.377028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-TestVolumeBootPattern-717289528-project Aug 29 20:39:04.377028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:39:04.377028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:39:04.377028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: fca06f41184444ccb0ddb57e5d44f227 Aug 29 20:39:04.377028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-TestVolumeBootPattern-717289528-project Aug 29 20:39:04.377028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:39:04.377028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:39:04.377028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '1773df51-c30e-4b2d-8497-eb95021c3efa'} Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:39:04.377979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:39:04.380482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:04.381822 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d63a9476-4967-4942-94ec-e5fed57904ae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Returning 404 to user: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:39:04.381822 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d63a9476-4967-4942-94ec-e5fed57904ae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 404 len: 111 microversion: 2.1 time: 0.038313 Aug 29 20:39:04.381822 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 366/750] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:04 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:39:04.414874 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7d9a39aa-7398-4ff2-a6fb-8e1929e7865c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:04.418484 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:04.429121 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7d9a39aa-7398-4ff2-a6fb-8e1929e7865c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1507 microversion: 2.1 time: 0.197212 Aug 29 20:39:04.430042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 385/751] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:04 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1507 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:04.452780 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4529ca4c-4b9c-484b-9018-1c3637e50ec8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:39:04.454030 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4529ca4c-4b9c-484b-9018-1c3637e50ec8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:04.460937 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4529ca4c-4b9c-484b-9018-1c3637e50ec8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:04.461786 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4529ca4c-4b9c-484b-9018-1c3637e50ec8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:04.462415 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4529ca4c-4b9c-484b-9018-1c3637e50ec8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:04.463677 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4529ca4c-4b9c-484b-9018-1c3637e50ec8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:04.464314 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4529ca4c-4b9c-484b-9018-1c3637e50ec8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:04.464910 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4529ca4c-4b9c-484b-9018-1c3637e50ec8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:04.498439 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4529ca4c-4b9c-484b-9018-1c3637e50ec8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127028) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 20:39:04.515721 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-803273335", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1635581417", "security_groups": [{"name": "tempest-secgroup-smoke-403245879"}], "block_device_mapping_v2": [{"uuid": "8eed41f4-8293-4e2f-ac7b-87ef37ec8ccf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6506ef9d-c593-4e22-ac07-3e14f3411bf3"}]}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:39:04.542974 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:04.580955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4529ca4c-4b9c-484b-9018-1c3637e50ec8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "POST /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1/action" status: 202 len: 0 microversion: 2.1 time: 0.132735 Aug 29 20:39:04.581852 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 367/752] 10.222.0.18 () {60 vars in 1278 bytes} [Mon Aug 29 20:39:04 2022] POST /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:39:04.591387 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1dfb56f9-9e28-4763-a4e3-c459dd2c0835 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:04.592235 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1dfb56f9-9e28-4763-a4e3-c459dd2c0835 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:04.600171 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dfb56f9-9e28-4763-a4e3-c459dd2c0835 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:04.600669 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dfb56f9-9e28-4763-a4e3-c459dd2c0835 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:04.601116 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dfb56f9-9e28-4763-a4e3-c459dd2c0835 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:04.601856 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dfb56f9-9e28-4763-a4e3-c459dd2c0835 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:04.602323 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dfb56f9-9e28-4763-a4e3-c459dd2c0835 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:04.602752 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dfb56f9-9e28-4763-a4e3-c459dd2c0835 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:04.674451 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.network.neutron [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] validate_networks() for [('6506ef9d-c593-4e22-ac07-3e14f3411bf3', None, None, None, None, None)] {{(pid=127027) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:39:04.896358 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1dfb56f9-9e28-4763-a4e3-c459dd2c0835 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:04.905405 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1dfb56f9-9e28-4763-a4e3-c459dd2c0835 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1515 microversion: 2.1 time: 0.319388 Aug 29 20:39:04.906588 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 368/753] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:04 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1515 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:05.187478 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Flavor limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:39:05.188602 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Image limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:39:05.189173 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Flavor pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:39:05.189658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Image pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:39:05.190141 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:39:05.210547 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:05.211199 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:05.211645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:05.212432 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:05.213467 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:05.214066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:05.241671 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Getting quotas for project 4ac573b4aa7a47c49d129afd9939e26d. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:39:05.247352 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Getting quotas for user fca06f41184444ccb0ddb57e5d44f227 and project 4ac573b4aa7a47c49d129afd9939e26d. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:39:05.270461 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-cd61fc99-7bf3-403c-b607-13cdcfba4301 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0661e9fb-d899-45bf-a544-9fa45a7c92cc"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:39:05.273746 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-cd61fc99-7bf3-403c-b607-13cdcfba4301 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:05.282643 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd61fc99-7bf3-403c-b607-13cdcfba4301 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:05.283505 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd61fc99-7bf3-403c-b607-13cdcfba4301 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:05.284045 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd61fc99-7bf3-403c-b607-13cdcfba4301 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:05.284858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd61fc99-7bf3-403c-b607-13cdcfba4301 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:05.285327 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd61fc99-7bf3-403c-b607-13cdcfba4301 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:05.285759 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-cd61fc99-7bf3-403c-b607-13cdcfba4301 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:05.353674 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Going to run 1 instances... {{(pid=127027) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:39:05.355855 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8eed41f4-8293-4e2f-ac7b-87ef37ec8ccf',volume_size=None,volume_type=None)] {{(pid=127027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:39:05.565054 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-47bf84a3-8aac-487a-825e-bb665cbb9d49 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.053850 Aug 29 20:39:05.566212 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 386/754] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:39:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:39:05.578096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-810f35c1-337b-4d05-972b-67e3567c34a6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:05.578990 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-810f35c1-337b-4d05-972b-67e3567c34a6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:05.693577 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-810f35c1-337b-4d05-972b-67e3567c34a6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:05.701893 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-810f35c1-337b-4d05-972b-67e3567c34a6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1094 microversion: 2.1 time: 0.128342 Aug 29 20:39:05.702716 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 387/755] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:05 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1094 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:39:05.719018 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-cd61fc99-7bf3-403c-b607-13cdcfba4301 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "POST /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.457536 Aug 29 20:39:05.719779 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 369/756] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 29 20:39:05 2022] POST /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments => generated 194 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:39:05.927473 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-fa6b309e-262e-4c05-97c4-1d2df8eeccfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:05.928342 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-fa6b309e-262e-4c05-97c4-1d2df8eeccfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:05.938175 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fa6b309e-262e-4c05-97c4-1d2df8eeccfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:05.940273 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fa6b309e-262e-4c05-97c4-1d2df8eeccfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:05.942108 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fa6b309e-262e-4c05-97c4-1d2df8eeccfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:05.944931 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fa6b309e-262e-4c05-97c4-1d2df8eeccfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:05.945616 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fa6b309e-262e-4c05-97c4-1d2df8eeccfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:05.948042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fa6b309e-262e-4c05-97c4-1d2df8eeccfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:06.202299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-fa6b309e-262e-4c05-97c4-1d2df8eeccfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:06.214108 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-fa6b309e-262e-4c05-97c4-1d2df8eeccfe tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1517 microversion: 2.1 time: 0.290203 Aug 29 20:39:06.216261 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 388/757] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:05 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1517 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:39:06.735888 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7fe4c97b-d916-42d1-9075-5cd867b753b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:06.736639 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7fe4c97b-d916-42d1-9075-5cd867b753b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:06.742784 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fe4c97b-d916-42d1-9075-5cd867b753b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:06.743259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fe4c97b-d916-42d1-9075-5cd867b753b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:06.743697 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fe4c97b-d916-42d1-9075-5cd867b753b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:06.744442 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fe4c97b-d916-42d1-9075-5cd867b753b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:06.744889 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fe4c97b-d916-42d1-9075-5cd867b753b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:06.745305 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7fe4c97b-d916-42d1-9075-5cd867b753b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:06.825498 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7fe4c97b-d916-42d1-9075-5cd867b753b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:06.833455 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7fe4c97b-d916-42d1-9075-5cd867b753b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1192 microversion: 2.1 time: 0.102232 Aug 29 20:39:06.834192 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 370/758] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:06 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:07.240024 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2c14e899-e762-4407-b382-4c8c26e95176 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:07.241241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2c14e899-e762-4407-b382-4c8c26e95176 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:07.264317 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c14e899-e762-4407-b382-4c8c26e95176 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:07.265289 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c14e899-e762-4407-b382-4c8c26e95176 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:07.265766 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c14e899-e762-4407-b382-4c8c26e95176 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:07.266525 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c14e899-e762-4407-b382-4c8c26e95176 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:07.266980 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c14e899-e762-4407-b382-4c8c26e95176 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:07.267403 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c14e899-e762-4407-b382-4c8c26e95176 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:07.562302 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2c14e899-e762-4407-b382-4c8c26e95176 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:07.570802 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2c14e899-e762-4407-b382-4c8c26e95176 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1517 microversion: 2.1 time: 0.334497 Aug 29 20:39:07.585237 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 389/759] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:07 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1517 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:07.855506 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ca4c5872-0dcd-4a84-a186-f048b071eb14 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:07.856762 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ca4c5872-0dcd-4a84-a186-f048b071eb14 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:07.864426 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca4c5872-0dcd-4a84-a186-f048b071eb14 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:07.865033 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca4c5872-0dcd-4a84-a186-f048b071eb14 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:07.865714 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca4c5872-0dcd-4a84-a186-f048b071eb14 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:07.866660 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca4c5872-0dcd-4a84-a186-f048b071eb14 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:07.867375 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca4c5872-0dcd-4a84-a186-f048b071eb14 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:07.868122 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ca4c5872-0dcd-4a84-a186-f048b071eb14 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:08.142630 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ca4c5872-0dcd-4a84-a186-f048b071eb14 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:08.152102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ca4c5872-0dcd-4a84-a186-f048b071eb14 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1277 microversion: 2.1 time: 0.300765 Aug 29 20:39:08.152893 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 371/760] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:07 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1277 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:08.594098 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-352d2fc6-b1f5-43cf-9bc9-bd6ab709b7f0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:08.594709 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-352d2fc6-b1f5-43cf-9bc9-bd6ab709b7f0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:08.601542 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-352d2fc6-b1f5-43cf-9bc9-bd6ab709b7f0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:08.601994 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-352d2fc6-b1f5-43cf-9bc9-bd6ab709b7f0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:08.602635 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-352d2fc6-b1f5-43cf-9bc9-bd6ab709b7f0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:08.603859 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-352d2fc6-b1f5-43cf-9bc9-bd6ab709b7f0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:08.604565 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-352d2fc6-b1f5-43cf-9bc9-bd6ab709b7f0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:08.605241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-352d2fc6-b1f5-43cf-9bc9-bd6ab709b7f0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:08.819135 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-352d2fc6-b1f5-43cf-9bc9-bd6ab709b7f0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:08.828751 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-352d2fc6-b1f5-43cf-9bc9-bd6ab709b7f0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1517 microversion: 2.1 time: 0.238263 Aug 29 20:39:08.829375 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 390/761] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:08 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1517 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:08.872749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-28ff96a7-13df-4275-87f9-6db7baa41427 req-649be0bf-9738-45c9-b569-8c10ce48e697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570c9c7b-50b9-4879-bb2d-c91da2ead6b5", "tag": "740dee41-866c-4314-89ee-4f035ccd2e9a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:39:08.882924 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-28ff96a7-13df-4275-87f9-6db7baa41427 req-649be0bf-9738-45c9-b569-8c10ce48e697 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:08.883484 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-28ff96a7-13df-4275-87f9-6db7baa41427 req-649be0bf-9738-45c9-b569-8c10ce48e697 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:08.884040 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-28ff96a7-13df-4275-87f9-6db7baa41427 req-649be0bf-9738-45c9-b569-8c10ce48e697 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:08.896138 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-28ff96a7-13df-4275-87f9-6db7baa41427 req-649be0bf-9738-45c9-b569-8c10ce48e697 service nova] Creating event network-changed:740dee41-866c-4314-89ee-4f035ccd2e9a for instance 570c9c7b-50b9-4879-bb2d-c91da2ead6b5 on hv-cinder-85426 Aug 29 20:39:08.901694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-28ff96a7-13df-4275-87f9-6db7baa41427 req-649be0bf-9738-45c9-b569-8c10ce48e697 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032341 Aug 29 20:39:08.902893 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 372/762] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:39:09.173803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-5d06a74c-d773-46f9-85c4-4e06d5eefd19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:09.174509 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-5d06a74c-d773-46f9-85c4-4e06d5eefd19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:09.180748 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5d06a74c-d773-46f9-85c4-4e06d5eefd19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:09.181390 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5d06a74c-d773-46f9-85c4-4e06d5eefd19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:09.181824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5d06a74c-d773-46f9-85c4-4e06d5eefd19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:09.182703 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5d06a74c-d773-46f9-85c4-4e06d5eefd19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:09.183159 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5d06a74c-d773-46f9-85c4-4e06d5eefd19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:09.183583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5d06a74c-d773-46f9-85c4-4e06d5eefd19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:09.406149 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-5d06a74c-d773-46f9-85c4-4e06d5eefd19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:09.414380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-5d06a74c-d773-46f9-85c4-4e06d5eefd19 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1277 microversion: 2.1 time: 0.244465 Aug 29 20:39:09.415176 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 391/763] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:09 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1277 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:39:09.850973 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ffa683c1-9aea-49f0-a249-7c99805992e8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:09.851679 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ffa683c1-9aea-49f0-a249-7c99805992e8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:09.858651 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffa683c1-9aea-49f0-a249-7c99805992e8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:09.859066 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffa683c1-9aea-49f0-a249-7c99805992e8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:09.859500 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffa683c1-9aea-49f0-a249-7c99805992e8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:09.860237 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffa683c1-9aea-49f0-a249-7c99805992e8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:09.860691 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffa683c1-9aea-49f0-a249-7c99805992e8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:09.861119 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ffa683c1-9aea-49f0-a249-7c99805992e8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:10.025634 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ffa683c1-9aea-49f0-a249-7c99805992e8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:10.036486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ffa683c1-9aea-49f0-a249-7c99805992e8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1517 microversion: 2.1 time: 0.190017 Aug 29 20:39:10.037065 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 373/764] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:09 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:10.435647 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-35c5fd09-e4b9-49c9-90cb-fa0d83c77988 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:10.437014 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-35c5fd09-e4b9-49c9-90cb-fa0d83c77988 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:10.444801 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-35c5fd09-e4b9-49c9-90cb-fa0d83c77988 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:10.445710 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-35c5fd09-e4b9-49c9-90cb-fa0d83c77988 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:10.446355 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-35c5fd09-e4b9-49c9-90cb-fa0d83c77988 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:10.447244 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-35c5fd09-e4b9-49c9-90cb-fa0d83c77988 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:10.447830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-35c5fd09-e4b9-49c9-90cb-fa0d83c77988 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:10.448612 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-35c5fd09-e4b9-49c9-90cb-fa0d83c77988 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:10.599900 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-35c5fd09-e4b9-49c9-90cb-fa0d83c77988 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:10.607981 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-35c5fd09-e4b9-49c9-90cb-fa0d83c77988 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1277 microversion: 2.1 time: 0.176558 Aug 29 20:39:10.608615 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 392/765] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:10 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:39:11.060992 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8480249f-aae8-4086-a504-1644acbf013c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:11.061854 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8480249f-aae8-4086-a504-1644acbf013c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:11.068481 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8480249f-aae8-4086-a504-1644acbf013c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:11.068936 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8480249f-aae8-4086-a504-1644acbf013c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:11.069365 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8480249f-aae8-4086-a504-1644acbf013c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:11.070058 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8480249f-aae8-4086-a504-1644acbf013c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:11.070537 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8480249f-aae8-4086-a504-1644acbf013c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:11.070929 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8480249f-aae8-4086-a504-1644acbf013c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:11.245464 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8480249f-aae8-4086-a504-1644acbf013c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:11.266510 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8480249f-aae8-4086-a504-1644acbf013c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1517 microversion: 2.1 time: 0.209635 Aug 29 20:39:11.267081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 374/766] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:11 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1517 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:11.628914 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-592e26c4-947d-4014-a38b-659fa3ec250f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:11.630150 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-592e26c4-947d-4014-a38b-659fa3ec250f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:11.637385 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-592e26c4-947d-4014-a38b-659fa3ec250f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:11.637866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-592e26c4-947d-4014-a38b-659fa3ec250f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:11.638300 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-592e26c4-947d-4014-a38b-659fa3ec250f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:11.638997 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-592e26c4-947d-4014-a38b-659fa3ec250f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:11.639588 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-592e26c4-947d-4014-a38b-659fa3ec250f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:11.639864 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-592e26c4-947d-4014-a38b-659fa3ec250f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:11.790247 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-592e26c4-947d-4014-a38b-659fa3ec250f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:11.798421 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-592e26c4-947d-4014-a38b-659fa3ec250f tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1277 microversion: 2.1 time: 0.173247 Aug 29 20:39:11.799003 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 393/767] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:11 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:12.288780 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-48dbbc8d-2b8b-4396-ab43-eb602f85fb22 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:12.289973 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-48dbbc8d-2b8b-4396-ab43-eb602f85fb22 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:12.300704 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48dbbc8d-2b8b-4396-ab43-eb602f85fb22 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:12.301443 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48dbbc8d-2b8b-4396-ab43-eb602f85fb22 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:12.302233 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48dbbc8d-2b8b-4396-ab43-eb602f85fb22 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:12.303105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48dbbc8d-2b8b-4396-ab43-eb602f85fb22 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:12.303722 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48dbbc8d-2b8b-4396-ab43-eb602f85fb22 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:12.304349 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-48dbbc8d-2b8b-4396-ab43-eb602f85fb22 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:12.400768 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9bebcb95-76b6-47ea-850d-1f90d15c0492 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:12.402996 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9bebcb95-76b6-47ea-850d-1f90d15c0492 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:12.409482 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9bebcb95-76b6-47ea-850d-1f90d15c0492 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:12.410005 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9bebcb95-76b6-47ea-850d-1f90d15c0492 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:12.410459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9bebcb95-76b6-47ea-850d-1f90d15c0492 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:12.411319 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9bebcb95-76b6-47ea-850d-1f90d15c0492 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:12.411835 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9bebcb95-76b6-47ea-850d-1f90d15c0492 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:12.412569 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9bebcb95-76b6-47ea-850d-1f90d15c0492 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:12.458617 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9bebcb95-76b6-47ea-850d-1f90d15c0492 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063016 Aug 29 20:39:12.459408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 394/768] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:39:12 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:39:12.465957 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-48dbbc8d-2b8b-4396-ab43-eb602f85fb22 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:12.471562 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-3bd69f6e-532c-460f-9363-16259cb2e007 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:12.472233 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-3bd69f6e-532c-460f-9363-16259cb2e007 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:12.474672 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-48dbbc8d-2b8b-4396-ab43-eb602f85fb22 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1517 microversion: 2.1 time: 0.189421 Aug 29 20:39:12.475242 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 375/769] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:12 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:12.479645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3bd69f6e-532c-460f-9363-16259cb2e007 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:12.480225 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3bd69f6e-532c-460f-9363-16259cb2e007 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:12.480855 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3bd69f6e-532c-460f-9363-16259cb2e007 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:12.481534 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3bd69f6e-532c-460f-9363-16259cb2e007 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:12.481985 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3bd69f6e-532c-460f-9363-16259cb2e007 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:12.482411 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-3bd69f6e-532c-460f-9363-16259cb2e007 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:12.513472 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-3bd69f6e-532c-460f-9363-16259cb2e007 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments/0661e9fb-d899-45bf-a544-9fa45a7c92cc" status: 200 len: 194 microversion: 2.1 time: 0.046118 Aug 29 20:39:12.514073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 395/770] 10.222.0.18 () {58 vars in 1413 bytes} [Mon Aug 29 20:39:12 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments/0661e9fb-d899-45bf-a544-9fa45a7c92cc => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:39:12.819507 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8d67c9fc-2554-4c15-88d3-753273b50482 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:12.820276 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8d67c9fc-2554-4c15-88d3-753273b50482 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:12.832023 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d67c9fc-2554-4c15-88d3-753273b50482 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:12.832782 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d67c9fc-2554-4c15-88d3-753273b50482 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:12.833583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d67c9fc-2554-4c15-88d3-753273b50482 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:12.835485 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d67c9fc-2554-4c15-88d3-753273b50482 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:12.836754 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d67c9fc-2554-4c15-88d3-753273b50482 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:12.837952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8d67c9fc-2554-4c15-88d3-753273b50482 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:13.010153 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8d67c9fc-2554-4c15-88d3-753273b50482 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:13.018640 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8d67c9fc-2554-4c15-88d3-753273b50482 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1277 microversion: 2.1 time: 0.203301 Aug 29 20:39:13.019655 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 376/771] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:12 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:13.498042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-612eaaa8-4ac5-4537-8029-78df7b4fc110 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:13.499402 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-612eaaa8-4ac5-4537-8029-78df7b4fc110 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:13.507038 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-612eaaa8-4ac5-4537-8029-78df7b4fc110 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:13.507918 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-612eaaa8-4ac5-4537-8029-78df7b4fc110 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:13.508554 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-612eaaa8-4ac5-4537-8029-78df7b4fc110 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:13.509827 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-612eaaa8-4ac5-4537-8029-78df7b4fc110 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:13.510285 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-612eaaa8-4ac5-4537-8029-78df7b4fc110 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:13.510748 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-612eaaa8-4ac5-4537-8029-78df7b4fc110 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:13.677193 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-612eaaa8-4ac5-4537-8029-78df7b4fc110 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:13.686036 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-612eaaa8-4ac5-4537-8029-78df7b4fc110 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1573 microversion: 2.1 time: 0.192680 Aug 29 20:39:13.686602 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 396/772] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:13 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1573 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:13.909532 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2f4f2198-2428-4c3e-9520-80cd7dc37e0e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "012cfc01-cf1a-45cd-9a7e-943604827107"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:39:13.911992 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2f4f2198-2428-4c3e-9520-80cd7dc37e0e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:13.920025 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f4f2198-2428-4c3e-9520-80cd7dc37e0e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:13.920514 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f4f2198-2428-4c3e-9520-80cd7dc37e0e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:13.920950 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f4f2198-2428-4c3e-9520-80cd7dc37e0e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:13.921651 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f4f2198-2428-4c3e-9520-80cd7dc37e0e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:13.922137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f4f2198-2428-4c3e-9520-80cd7dc37e0e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:13.922631 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2f4f2198-2428-4c3e-9520-80cd7dc37e0e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:14.043243 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-0076e86f-0ff7-4846-9242-c8a4d8c4bea4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:14.044105 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-0076e86f-0ff7-4846-9242-c8a4d8c4bea4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:14.050894 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0076e86f-0ff7-4846-9242-c8a4d8c4bea4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:14.051481 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0076e86f-0ff7-4846-9242-c8a4d8c4bea4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:14.052059 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0076e86f-0ff7-4846-9242-c8a4d8c4bea4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:14.064699 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0076e86f-0ff7-4846-9242-c8a4d8c4bea4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:14.065467 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0076e86f-0ff7-4846-9242-c8a4d8c4bea4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:14.066135 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0076e86f-0ff7-4846-9242-c8a4d8c4bea4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:14.204503 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2f4f2198-2428-4c3e-9520-80cd7dc37e0e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "POST /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299172 Aug 29 20:39:14.205112 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 377/773] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 29 20:39:13 2022] POST /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:39:14.333013 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-0076e86f-0ff7-4846-9242-c8a4d8c4bea4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:14.341624 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-0076e86f-0ff7-4846-9242-c8a4d8c4bea4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1265 microversion: 2.1 time: 0.303133 Aug 29 20:39:14.342194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 397/774] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:14 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:39:14.708460 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4198a5a4-58f2-476a-86a9-4ad82b02790d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:14.709053 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4198a5a4-58f2-476a-86a9-4ad82b02790d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:14.715710 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4198a5a4-58f2-476a-86a9-4ad82b02790d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:14.716225 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4198a5a4-58f2-476a-86a9-4ad82b02790d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:14.716663 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4198a5a4-58f2-476a-86a9-4ad82b02790d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:14.717366 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4198a5a4-58f2-476a-86a9-4ad82b02790d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:14.717821 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4198a5a4-58f2-476a-86a9-4ad82b02790d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:14.718246 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4198a5a4-58f2-476a-86a9-4ad82b02790d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:14.865134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-4198a5a4-58f2-476a-86a9-4ad82b02790d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:14.873460 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4198a5a4-58f2-476a-86a9-4ad82b02790d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1573 microversion: 2.1 time: 0.169960 Aug 29 20:39:14.874032 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 378/775] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:14 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:15.362525 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-88356717-b7d9-44cf-85cd-8e9dea738bae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:15.363127 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-88356717-b7d9-44cf-85cd-8e9dea738bae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:15.365450 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:15.371345 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-88356717-b7d9-44cf-85cd-8e9dea738bae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:15.371826 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-88356717-b7d9-44cf-85cd-8e9dea738bae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:15.372288 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-88356717-b7d9-44cf-85cd-8e9dea738bae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:15.373082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-88356717-b7d9-44cf-85cd-8e9dea738bae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:15.373439 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-88356717-b7d9-44cf-85cd-8e9dea738bae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:15.373852 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-88356717-b7d9-44cf-85cd-8e9dea738bae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:15.513266 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-88356717-b7d9-44cf-85cd-8e9dea738bae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:15.522847 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-88356717-b7d9-44cf-85cd-8e9dea738bae tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1265 microversion: 2.1 time: 0.164222 Aug 29 20:39:15.523405 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 398/776] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:15 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:15.894336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb33d6c7-e42c-4e82-88d2-cfc3b1546197 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:15.894882 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb33d6c7-e42c-4e82-88d2-cfc3b1546197 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:15.902126 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb33d6c7-e42c-4e82-88d2-cfc3b1546197 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:15.902606 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb33d6c7-e42c-4e82-88d2-cfc3b1546197 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:15.903041 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb33d6c7-e42c-4e82-88d2-cfc3b1546197 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:15.903736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb33d6c7-e42c-4e82-88d2-cfc3b1546197 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:15.904214 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb33d6c7-e42c-4e82-88d2-cfc3b1546197 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:15.904638 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb33d6c7-e42c-4e82-88d2-cfc3b1546197 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:16.035124 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-eb33d6c7-e42c-4e82-88d2-cfc3b1546197 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:16.043192 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb33d6c7-e42c-4e82-88d2-cfc3b1546197 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1573 microversion: 2.1 time: 0.152871 Aug 29 20:39:16.043765 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 379/777] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:15 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:16.544745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4eba0ae0-400c-4fc3-a684-a532e450255c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:16.545477 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4eba0ae0-400c-4fc3-a684-a532e450255c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:16.548360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=8 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:16.553287 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4eba0ae0-400c-4fc3-a684-a532e450255c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:16.553764 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4eba0ae0-400c-4fc3-a684-a532e450255c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:16.554190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4eba0ae0-400c-4fc3-a684-a532e450255c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:16.554912 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4eba0ae0-400c-4fc3-a684-a532e450255c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:16.555359 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4eba0ae0-400c-4fc3-a684-a532e450255c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:16.555792 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4eba0ae0-400c-4fc3-a684-a532e450255c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:16.698373 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4eba0ae0-400c-4fc3-a684-a532e450255c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:16.706332 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4eba0ae0-400c-4fc3-a684-a532e450255c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1265 microversion: 2.1 time: 0.165938 Aug 29 20:39:16.706900 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 399/778] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:16 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:17.064863 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-07d963df-aac4-4fd4-b750-30f717e7fcd0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:17.065476 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-07d963df-aac4-4fd4-b750-30f717e7fcd0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:17.072041 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07d963df-aac4-4fd4-b750-30f717e7fcd0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:17.072537 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07d963df-aac4-4fd4-b750-30f717e7fcd0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:17.072974 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07d963df-aac4-4fd4-b750-30f717e7fcd0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:17.073674 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07d963df-aac4-4fd4-b750-30f717e7fcd0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:17.074208 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07d963df-aac4-4fd4-b750-30f717e7fcd0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:17.074592 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-07d963df-aac4-4fd4-b750-30f717e7fcd0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:17.211392 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-07d963df-aac4-4fd4-b750-30f717e7fcd0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:17.219721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-07d963df-aac4-4fd4-b750-30f717e7fcd0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1573 microversion: 2.1 time: 0.158741 Aug 29 20:39:17.220316 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 380/779] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:17 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:17.727241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7fc0b4e3-8e78-4c88-9488-cf652b23d045 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:17.727862 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7fc0b4e3-8e78-4c88-9488-cf652b23d045 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:17.734389 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7fc0b4e3-8e78-4c88-9488-cf652b23d045 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:17.734866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7fc0b4e3-8e78-4c88-9488-cf652b23d045 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:17.735294 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7fc0b4e3-8e78-4c88-9488-cf652b23d045 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:17.736003 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7fc0b4e3-8e78-4c88-9488-cf652b23d045 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:17.736477 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7fc0b4e3-8e78-4c88-9488-cf652b23d045 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:17.736873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7fc0b4e3-8e78-4c88-9488-cf652b23d045 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:17.871983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7fc0b4e3-8e78-4c88-9488-cf652b23d045 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:17.878932 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7fc0b4e3-8e78-4c88-9488-cf652b23d045 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1265 microversion: 2.1 time: 0.155636 Aug 29 20:39:17.879505 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 400/780] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:17 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:18.241333 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fc68a49d-be0d-462a-abb7-a46e33e48247 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:18.241944 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fc68a49d-be0d-462a-abb7-a46e33e48247 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:18.248894 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc68a49d-be0d-462a-abb7-a46e33e48247 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:18.249363 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc68a49d-be0d-462a-abb7-a46e33e48247 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:18.249787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc68a49d-be0d-462a-abb7-a46e33e48247 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:18.250465 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc68a49d-be0d-462a-abb7-a46e33e48247 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:18.250909 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc68a49d-be0d-462a-abb7-a46e33e48247 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:18.251322 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fc68a49d-be0d-462a-abb7-a46e33e48247 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:18.382025 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-fc68a49d-be0d-462a-abb7-a46e33e48247 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:18.384356 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:18.391849 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fc68a49d-be0d-462a-abb7-a46e33e48247 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1573 microversion: 2.1 time: 0.154382 Aug 29 20:39:18.392628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 381/781] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:18 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:18.901080 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e731536a-bbb3-4c42-86e3-74159961a467 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:18.901685 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e731536a-bbb3-4c42-86e3-74159961a467 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:18.908425 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e731536a-bbb3-4c42-86e3-74159961a467 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:18.908904 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e731536a-bbb3-4c42-86e3-74159961a467 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:18.909330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e731536a-bbb3-4c42-86e3-74159961a467 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:18.910008 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e731536a-bbb3-4c42-86e3-74159961a467 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:18.910454 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e731536a-bbb3-4c42-86e3-74159961a467 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:18.910866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e731536a-bbb3-4c42-86e3-74159961a467 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:19.042024 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e731536a-bbb3-4c42-86e3-74159961a467 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:19.049831 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e731536a-bbb3-4c42-86e3-74159961a467 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1265 microversion: 2.1 time: 0.153178 Aug 29 20:39:19.050421 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 401/782] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:18 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:19.413827 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c57d27d5-672c-4974-8972-4bbc86ae114c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:19.414443 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c57d27d5-672c-4974-8972-4bbc86ae114c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:19.421544 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c57d27d5-672c-4974-8972-4bbc86ae114c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:19.422031 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c57d27d5-672c-4974-8972-4bbc86ae114c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:19.422465 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c57d27d5-672c-4974-8972-4bbc86ae114c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:19.423161 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c57d27d5-672c-4974-8972-4bbc86ae114c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:19.423613 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c57d27d5-672c-4974-8972-4bbc86ae114c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:19.424062 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c57d27d5-672c-4974-8972-4bbc86ae114c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:19.562335 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c57d27d5-672c-4974-8972-4bbc86ae114c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:19.570536 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c57d27d5-672c-4974-8972-4bbc86ae114c tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1573 microversion: 2.1 time: 0.160946 Aug 29 20:39:19.571088 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 382/783] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:19 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:20.070248 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2c219cf5-6215-4d4b-b8e3-7b6bc836081d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:20.070864 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2c219cf5-6215-4d4b-b8e3-7b6bc836081d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:20.077824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c219cf5-6215-4d4b-b8e3-7b6bc836081d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:20.078297 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c219cf5-6215-4d4b-b8e3-7b6bc836081d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:20.078722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c219cf5-6215-4d4b-b8e3-7b6bc836081d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:20.079401 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c219cf5-6215-4d4b-b8e3-7b6bc836081d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:20.079844 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c219cf5-6215-4d4b-b8e3-7b6bc836081d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:20.080287 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c219cf5-6215-4d4b-b8e3-7b6bc836081d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:20.219149 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2c219cf5-6215-4d4b-b8e3-7b6bc836081d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:20.226727 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2c219cf5-6215-4d4b-b8e3-7b6bc836081d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1265 microversion: 2.1 time: 0.160295 Aug 29 20:39:20.227288 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 402/784] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:20 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:20.590449 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b0539318-fb74-453f-9faa-4c7a75381555 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:20.591100 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0539318-fb74-453f-9faa-4c7a75381555 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:20.597751 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0539318-fb74-453f-9faa-4c7a75381555 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:20.598225 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0539318-fb74-453f-9faa-4c7a75381555 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:20.598651 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0539318-fb74-453f-9faa-4c7a75381555 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:20.599340 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0539318-fb74-453f-9faa-4c7a75381555 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:20.599792 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0539318-fb74-453f-9faa-4c7a75381555 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:20.600236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0539318-fb74-453f-9faa-4c7a75381555 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:20.732821 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-b0539318-fb74-453f-9faa-4c7a75381555 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:20.740613 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b0539318-fb74-453f-9faa-4c7a75381555 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1573 microversion: 2.1 time: 0.154115 Aug 29 20:39:20.741195 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 383/785] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:20 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:21.248511 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-426b2da3-0bd7-4ac6-a5d9-bc4a709db298 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:21.249238 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-426b2da3-0bd7-4ac6-a5d9-bc4a709db298 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:21.256226 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-426b2da3-0bd7-4ac6-a5d9-bc4a709db298 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:21.256956 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-426b2da3-0bd7-4ac6-a5d9-bc4a709db298 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:21.257390 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-426b2da3-0bd7-4ac6-a5d9-bc4a709db298 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:21.258087 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-426b2da3-0bd7-4ac6-a5d9-bc4a709db298 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:21.258533 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-426b2da3-0bd7-4ac6-a5d9-bc4a709db298 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:21.259426 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-426b2da3-0bd7-4ac6-a5d9-bc4a709db298 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:21.446495 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-426b2da3-0bd7-4ac6-a5d9-bc4a709db298 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:21.456550 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-426b2da3-0bd7-4ac6-a5d9-bc4a709db298 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1265 microversion: 2.1 time: 0.212015 Aug 29 20:39:21.457437 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 403/786] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:21 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:21.762954 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-85424417-ca81-4273-9c4a-e1962386dc05 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:21.763682 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-85424417-ca81-4273-9c4a-e1962386dc05 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:21.770855 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85424417-ca81-4273-9c4a-e1962386dc05 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:21.771354 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85424417-ca81-4273-9c4a-e1962386dc05 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:21.771857 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85424417-ca81-4273-9c4a-e1962386dc05 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:21.772627 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85424417-ca81-4273-9c4a-e1962386dc05 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:21.773090 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85424417-ca81-4273-9c4a-e1962386dc05 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:21.773649 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-85424417-ca81-4273-9c4a-e1962386dc05 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:21.937033 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-85424417-ca81-4273-9c4a-e1962386dc05 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:21.945805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-85424417-ca81-4273-9c4a-e1962386dc05 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1573 microversion: 2.1 time: 0.187659 Aug 29 20:39:21.946422 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 384/787] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:21 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1573 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:22.479257 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-858d4719-f3fe-4c49-9df9-83762bd07a45 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:22.480562 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-858d4719-f3fe-4c49-9df9-83762bd07a45 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:22.487350 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-858d4719-f3fe-4c49-9df9-83762bd07a45 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:22.487851 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-858d4719-f3fe-4c49-9df9-83762bd07a45 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:22.488326 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-858d4719-f3fe-4c49-9df9-83762bd07a45 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:22.489341 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-858d4719-f3fe-4c49-9df9-83762bd07a45 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:22.489698 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-858d4719-f3fe-4c49-9df9-83762bd07a45 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:22.490291 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-858d4719-f3fe-4c49-9df9-83762bd07a45 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:22.494932 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=100 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:22.644097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-858d4719-f3fe-4c49-9df9-83762bd07a45 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:22.653717 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-858d4719-f3fe-4c49-9df9-83762bd07a45 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1265 microversion: 2.1 time: 0.178862 Aug 29 20:39:22.654803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 404/788] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:22 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:22.828548 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-eb194289-9f16-43e1-855f-e68ddb7561e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:22.830590 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-eb194289-9f16-43e1-855f-e68ddb7561e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:22.838090 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb194289-9f16-43e1-855f-e68ddb7561e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:22.838659 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb194289-9f16-43e1-855f-e68ddb7561e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:22.839018 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb194289-9f16-43e1-855f-e68ddb7561e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:22.839726 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb194289-9f16-43e1-855f-e68ddb7561e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:22.840287 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb194289-9f16-43e1-855f-e68ddb7561e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:22.840717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-eb194289-9f16-43e1-855f-e68ddb7561e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:22.871642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-eb194289-9f16-43e1-855f-e68ddb7561e5 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047599 Aug 29 20:39:22.872272 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 385/789] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:39:22 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:39:22.967053 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1c7ca44a-1515-425e-8379-24be7d88c177 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:22.967666 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1c7ca44a-1515-425e-8379-24be7d88c177 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:22.973988 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1c7ca44a-1515-425e-8379-24be7d88c177 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:22.974472 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1c7ca44a-1515-425e-8379-24be7d88c177 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:22.974907 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1c7ca44a-1515-425e-8379-24be7d88c177 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:22.975605 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1c7ca44a-1515-425e-8379-24be7d88c177 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:22.976087 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1c7ca44a-1515-425e-8379-24be7d88c177 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:22.976513 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1c7ca44a-1515-425e-8379-24be7d88c177 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:23.020482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b0a6167-94f3-4486-8d44-cb143f64a787 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:23.021059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7b0a6167-94f3-4486-8d44-cb143f64a787 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:23.029591 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b0a6167-94f3-4486-8d44-cb143f64a787 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:23.030292 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b0a6167-94f3-4486-8d44-cb143f64a787 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:23.030962 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b0a6167-94f3-4486-8d44-cb143f64a787 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:23.032564 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b0a6167-94f3-4486-8d44-cb143f64a787 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:23.032858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b0a6167-94f3-4486-8d44-cb143f64a787 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:23.033523 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b0a6167-94f3-4486-8d44-cb143f64a787 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:23.066981 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7b0a6167-94f3-4486-8d44-cb143f64a787 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments/0661e9fb-d899-45bf-a544-9fa45a7c92cc" status: 200 len: 194 microversion: 2.1 time: 0.053720 Aug 29 20:39:23.070388 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 386/790] 10.222.0.18 () {58 vars in 1413 bytes} [Mon Aug 29 20:39:23 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments/0661e9fb-d899-45bf-a544-9fa45a7c92cc => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:39:23.079571 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-38939be4-e760-4763-977e-638e598be4ec tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:23.080014 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-38939be4-e760-4763-977e-638e598be4ec tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:23.086806 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38939be4-e760-4763-977e-638e598be4ec tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:23.087460 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38939be4-e760-4763-977e-638e598be4ec tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:23.087721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38939be4-e760-4763-977e-638e598be4ec tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:23.088462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38939be4-e760-4763-977e-638e598be4ec tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:23.088927 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38939be4-e760-4763-977e-638e598be4ec tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:23.089410 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38939be4-e760-4763-977e-638e598be4ec tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:23.140523 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1c7ca44a-1515-425e-8379-24be7d88c177 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:23.148458 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1c7ca44a-1515-425e-8379-24be7d88c177 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1573 microversion: 2.1 time: 0.185500 Aug 29 20:39:23.149041 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 405/791] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:22 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1573 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:23.178458 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-38939be4-e760-4763-977e-638e598be4ec tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lazy-loading 'services' on Instance uuid fe56a6be-788d-44c6-a116-577a344df4c7 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:39:23.257242 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-38939be4-e760-4763-977e-638e598be4ec tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments/0661e9fb-d899-45bf-a544-9fa45a7c92cc" status: 202 len: 0 microversion: 2.1 time: 0.181973 Aug 29 20:39:23.258327 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 387/792] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 29 20:39:23 2022] DELETE /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments/0661e9fb-d899-45bf-a544-9fa45a7c92cc => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:39:23.590564 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-0ab94f16-a0e0-45f2-8e3f-4d1dcc3fb30d req-6c20ec6c-2732-4b61-93fc-b8062a872869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570c9c7b-50b9-4879-bb2d-c91da2ead6b5", "name": "network-vif-plugged", "status": "completed", "tag": "740dee41-866c-4314-89ee-4f035ccd2e9a"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:39:23.601037 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-0ab94f16-a0e0-45f2-8e3f-4d1dcc3fb30d req-6c20ec6c-2732-4b61-93fc-b8062a872869 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:23.601672 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-0ab94f16-a0e0-45f2-8e3f-4d1dcc3fb30d req-6c20ec6c-2732-4b61-93fc-b8062a872869 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:23.602161 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-0ab94f16-a0e0-45f2-8e3f-4d1dcc3fb30d req-6c20ec6c-2732-4b61-93fc-b8062a872869 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:23.614687 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-0ab94f16-a0e0-45f2-8e3f-4d1dcc3fb30d req-6c20ec6c-2732-4b61-93fc-b8062a872869 service nova] Creating event network-vif-plugged:740dee41-866c-4314-89ee-4f035ccd2e9a for instance 570c9c7b-50b9-4879-bb2d-c91da2ead6b5 on hv-cinder-85426 Aug 29 20:39:23.620555 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-0ab94f16-a0e0-45f2-8e3f-4d1dcc3fb30d req-6c20ec6c-2732-4b61-93fc-b8062a872869 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033754 Aug 29 20:39:23.621366 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 406/793] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:39:23.674613 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6e89f183-bd25-4446-9433-daff65196a3d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:23.675995 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6e89f183-bd25-4446-9433-daff65196a3d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:23.682653 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e89f183-bd25-4446-9433-daff65196a3d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:23.683373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e89f183-bd25-4446-9433-daff65196a3d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:23.683820 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e89f183-bd25-4446-9433-daff65196a3d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:23.684557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e89f183-bd25-4446-9433-daff65196a3d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:23.685275 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e89f183-bd25-4446-9433-daff65196a3d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:23.685702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e89f183-bd25-4446-9433-daff65196a3d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:23.829409 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6e89f183-bd25-4446-9433-daff65196a3d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:23.840456 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6e89f183-bd25-4446-9433-daff65196a3d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1265 microversion: 2.1 time: 0.170058 Aug 29 20:39:23.852036 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 388/794] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:23 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:24.172498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7261611b-ab43-40f0-b9b1-44f0d14a16d2 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:24.173446 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7261611b-ab43-40f0-b9b1-44f0d14a16d2 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:24.181488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7261611b-ab43-40f0-b9b1-44f0d14a16d2 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:24.182425 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7261611b-ab43-40f0-b9b1-44f0d14a16d2 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:24.183192 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7261611b-ab43-40f0-b9b1-44f0d14a16d2 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:24.184690 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7261611b-ab43-40f0-b9b1-44f0d14a16d2 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:24.185419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7261611b-ab43-40f0-b9b1-44f0d14a16d2 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:24.185836 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7261611b-ab43-40f0-b9b1-44f0d14a16d2 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:24.397691 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7261611b-ab43-40f0-b9b1-44f0d14a16d2 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:24.406498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7261611b-ab43-40f0-b9b1-44f0d14a16d2 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1573 microversion: 2.1 time: 0.238187 Aug 29 20:39:24.407240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 407/795] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:24 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1573 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:24.861997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ef59e34f-340e-4ebd-83d8-3134858092e0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:24.863386 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ef59e34f-340e-4ebd-83d8-3134858092e0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:24.870950 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef59e34f-340e-4ebd-83d8-3134858092e0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:24.871650 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef59e34f-340e-4ebd-83d8-3134858092e0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:24.872826 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef59e34f-340e-4ebd-83d8-3134858092e0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:24.873837 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef59e34f-340e-4ebd-83d8-3134858092e0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:24.874612 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef59e34f-340e-4ebd-83d8-3134858092e0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:24.875223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef59e34f-340e-4ebd-83d8-3134858092e0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:25.051595 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ef59e34f-340e-4ebd-83d8-3134858092e0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:25.063042 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ef59e34f-340e-4ebd-83d8-3134858092e0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1265 microversion: 2.1 time: 0.204417 Aug 29 20:39:25.063737 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 389/796] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:24 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:25.429851 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-54072e42-f032-41cf-8540-9f7d46512a47 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:25.430588 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-54072e42-f032-41cf-8540-9f7d46512a47 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:25.437701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54072e42-f032-41cf-8540-9f7d46512a47 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:25.438783 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54072e42-f032-41cf-8540-9f7d46512a47 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:25.440433 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54072e42-f032-41cf-8540-9f7d46512a47 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:25.441890 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54072e42-f032-41cf-8540-9f7d46512a47 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:25.442549 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54072e42-f032-41cf-8540-9f7d46512a47 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:25.443545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54072e42-f032-41cf-8540-9f7d46512a47 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:25.483147 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-83840ce1-b2b6-4e81-896d-1596b66146cd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:25.483805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-83840ce1-b2b6-4e81-896d-1596b66146cd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:25.506155 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83840ce1-b2b6-4e81-896d-1596b66146cd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:25.509242 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83840ce1-b2b6-4e81-896d-1596b66146cd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:25.510980 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83840ce1-b2b6-4e81-896d-1596b66146cd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:25.513691 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83840ce1-b2b6-4e81-896d-1596b66146cd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:25.514868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83840ce1-b2b6-4e81-896d-1596b66146cd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:25.516908 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-83840ce1-b2b6-4e81-896d-1596b66146cd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:25.562850 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-83840ce1-b2b6-4e81-896d-1596b66146cd tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments/012cfc01-cf1a-45cd-9a7e-943604827107" status: 200 len: 194 microversion: 2.1 time: 0.086054 Aug 29 20:39:25.563459 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 390/797] 10.222.0.18 () {58 vars in 1413 bytes} [Mon Aug 29 20:39:25 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments/012cfc01-cf1a-45cd-9a7e-943604827107 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:39:25.575227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-993c1ba1-7c1b-4ff6-88d0-12181a9a4e8f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:25.575835 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-993c1ba1-7c1b-4ff6-88d0-12181a9a4e8f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:25.582125 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-993c1ba1-7c1b-4ff6-88d0-12181a9a4e8f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:25.582741 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-993c1ba1-7c1b-4ff6-88d0-12181a9a4e8f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:25.583389 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-993c1ba1-7c1b-4ff6-88d0-12181a9a4e8f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:25.584299 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-993c1ba1-7c1b-4ff6-88d0-12181a9a4e8f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:25.584866 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-993c1ba1-7c1b-4ff6-88d0-12181a9a4e8f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:25.585375 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-993c1ba1-7c1b-4ff6-88d0-12181a9a4e8f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:25.612616 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-54072e42-f032-41cf-8540-9f7d46512a47 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:25.621783 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-54072e42-f032-41cf-8540-9f7d46512a47 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1573 microversion: 2.1 time: 0.196450 Aug 29 20:39:25.636168 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 408/798] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:25 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1573 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:25.646187 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-ea4616af-084c-4fcf-a830-8be79c0132ad req-4d61df7b-2780-44d8-81f5-32c528c4c9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36516f8-3de4-45fa-a124-83436dcfe1c1", "name": "network-vif-plugged", "status": "completed", "tag": "8ff3928a-585f-4fdd-9895-afd0c54f0e08"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:39:25.656461 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-ea4616af-084c-4fcf-a830-8be79c0132ad req-4d61df7b-2780-44d8-81f5-32c528c4c9bb service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:25.656932 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-ea4616af-084c-4fcf-a830-8be79c0132ad req-4d61df7b-2780-44d8-81f5-32c528c4c9bb service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:25.660260 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-ea4616af-084c-4fcf-a830-8be79c0132ad req-4d61df7b-2780-44d8-81f5-32c528c4c9bb service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:25.675816 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-ea4616af-084c-4fcf-a830-8be79c0132ad req-4d61df7b-2780-44d8-81f5-32c528c4c9bb service nova] Creating event network-vif-plugged:8ff3928a-585f-4fdd-9895-afd0c54f0e08 for instance f36516f8-3de4-45fa-a124-83436dcfe1c1 on hv-cinder-85426 Aug 29 20:39:25.679872 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-993c1ba1-7c1b-4ff6-88d0-12181a9a4e8f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lazy-loading 'services' on Instance uuid fe56a6be-788d-44c6-a116-577a344df4c7 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:39:25.681310 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-ea4616af-084c-4fcf-a830-8be79c0132ad req-4d61df7b-2780-44d8-81f5-32c528c4c9bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043120 Aug 29 20:39:25.682094 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 409/799] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:39:25.756433 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-993c1ba1-7c1b-4ff6-88d0-12181a9a4e8f tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments/012cfc01-cf1a-45cd-9a7e-943604827107" status: 202 len: 0 microversion: 2.1 time: 0.186173 Aug 29 20:39:25.756953 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 391/800] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 29 20:39:25 2022] DELETE /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments/012cfc01-cf1a-45cd-9a7e-943604827107 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:39:26.091160 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9dc718cb-2c85-4f42-b763-09bef90e8b39 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:26.093299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9dc718cb-2c85-4f42-b763-09bef90e8b39 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:26.106396 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9dc718cb-2c85-4f42-b763-09bef90e8b39 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:26.108521 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9dc718cb-2c85-4f42-b763-09bef90e8b39 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:26.109326 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9dc718cb-2c85-4f42-b763-09bef90e8b39 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:26.110310 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9dc718cb-2c85-4f42-b763-09bef90e8b39 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:26.111082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9dc718cb-2c85-4f42-b763-09bef90e8b39 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:26.111845 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9dc718cb-2c85-4f42-b763-09bef90e8b39 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:26.343234 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9dc718cb-2c85-4f42-b763-09bef90e8b39 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:26.356048 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9dc718cb-2c85-4f42-b763-09bef90e8b39 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1265 microversion: 2.1 time: 0.275513 Aug 29 20:39:26.357636 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 410/801] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:26 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:26.658689 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-441eb06c-f3a8-4146-a423-1e79641e4ceb tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:26.659799 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-441eb06c-f3a8-4146-a423-1e79641e4ceb tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:26.663808 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:26.674247 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-441eb06c-f3a8-4146-a423-1e79641e4ceb tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:26.675032 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-441eb06c-f3a8-4146-a423-1e79641e4ceb tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:26.675741 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-441eb06c-f3a8-4146-a423-1e79641e4ceb tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:26.676789 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-441eb06c-f3a8-4146-a423-1e79641e4ceb tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:26.677823 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-441eb06c-f3a8-4146-a423-1e79641e4ceb tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:26.678795 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-441eb06c-f3a8-4146-a423-1e79641e4ceb tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:26.922106 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-441eb06c-f3a8-4146-a423-1e79641e4ceb tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:26.930181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-441eb06c-f3a8-4146-a423-1e79641e4ceb tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1573 microversion: 2.1 time: 0.277470 Aug 29 20:39:26.930816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 392/802] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:26 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1573 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:27.378455 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-59a98118-ae53-46ec-bea1-6b3aa609e0f9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:27.379397 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-59a98118-ae53-46ec-bea1-6b3aa609e0f9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:27.387665 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59a98118-ae53-46ec-bea1-6b3aa609e0f9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:27.388520 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59a98118-ae53-46ec-bea1-6b3aa609e0f9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:27.389121 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59a98118-ae53-46ec-bea1-6b3aa609e0f9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:27.389987 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59a98118-ae53-46ec-bea1-6b3aa609e0f9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:27.390598 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59a98118-ae53-46ec-bea1-6b3aa609e0f9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:27.391259 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-59a98118-ae53-46ec-bea1-6b3aa609e0f9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:27.558468 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-59a98118-ae53-46ec-bea1-6b3aa609e0f9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:27.572289 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-59a98118-ae53-46ec-bea1-6b3aa609e0f9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1450 microversion: 2.1 time: 0.197445 Aug 29 20:39:27.573340 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 411/803] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:27 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1450 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:27.606134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bd8cdcc7-953a-4e66-aced-51fadca60998 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:27.606997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bd8cdcc7-953a-4e66-aced-51fadca60998 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:27.614000 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8cdcc7-953a-4e66-aced-51fadca60998 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:27.614492 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8cdcc7-953a-4e66-aced-51fadca60998 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:27.614932 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8cdcc7-953a-4e66-aced-51fadca60998 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:27.615634 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8cdcc7-953a-4e66-aced-51fadca60998 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:27.616197 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8cdcc7-953a-4e66-aced-51fadca60998 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:27.616925 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bd8cdcc7-953a-4e66-aced-51fadca60998 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:27.797539 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bd8cdcc7-953a-4e66-aced-51fadca60998 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:27.808787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bd8cdcc7-953a-4e66-aced-51fadca60998 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1450 microversion: 2.1 time: 0.206951 Aug 29 20:39:27.809343 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 393/804] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:27 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1450 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:27.957805 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9894f784-177f-41f7-ba0e-937b49d2483e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:27.959263 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9894f784-177f-41f7-ba0e-937b49d2483e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:27.972616 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9894f784-177f-41f7-ba0e-937b49d2483e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:27.973843 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9894f784-177f-41f7-ba0e-937b49d2483e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:27.975334 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9894f784-177f-41f7-ba0e-937b49d2483e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:27.976783 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9894f784-177f-41f7-ba0e-937b49d2483e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:27.978799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9894f784-177f-41f7-ba0e-937b49d2483e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:27.996890 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9894f784-177f-41f7-ba0e-937b49d2483e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:28.122165 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-090ae8fb-6c98-4b4b-babb-759d085edc7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:28.128190 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-090ae8fb-6c98-4b4b-babb-759d085edc7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:28.140631 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-090ae8fb-6c98-4b4b-babb-759d085edc7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:28.141453 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-090ae8fb-6c98-4b4b-babb-759d085edc7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:28.142470 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-090ae8fb-6c98-4b4b-babb-759d085edc7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:28.143708 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-090ae8fb-6c98-4b4b-babb-759d085edc7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:28.144576 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-090ae8fb-6c98-4b4b-babb-759d085edc7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:28.145599 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-090ae8fb-6c98-4b4b-babb-759d085edc7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:28.213284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-090ae8fb-6c98-4b4b-babb-759d085edc7b tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096518 Aug 29 20:39:28.214889 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 394/805] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:39:28 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:39:28.256196 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9894f784-177f-41f7-ba0e-937b49d2483e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:28.271276 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9894f784-177f-41f7-ba0e-937b49d2483e tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1560 microversion: 2.1 time: 0.321706 Aug 29 20:39:28.273164 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 412/806] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:27 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1560 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:28.432503 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d794270a-e664-42ee-921b-8f30f3b6aff4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:28.437571 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d794270a-e664-42ee-921b-8f30f3b6aff4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:28.449603 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d794270a-e664-42ee-921b-8f30f3b6aff4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:28.450494 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d794270a-e664-42ee-921b-8f30f3b6aff4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:28.451511 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d794270a-e664-42ee-921b-8f30f3b6aff4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:28.452999 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d794270a-e664-42ee-921b-8f30f3b6aff4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:28.453877 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d794270a-e664-42ee-921b-8f30f3b6aff4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:28.454697 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d794270a-e664-42ee-921b-8f30f3b6aff4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:28.509920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d794270a-e664-42ee-921b-8f30f3b6aff4 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086302 Aug 29 20:39:28.511990 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 395/807] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:39:28 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:39:28.620020 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-764168e6-c1f6-4a20-8bca-278e585dd175 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:28.620854 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-764168e6-c1f6-4a20-8bca-278e585dd175 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:28.630002 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-764168e6-c1f6-4a20-8bca-278e585dd175 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:28.630390 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-764168e6-c1f6-4a20-8bca-278e585dd175 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:28.630821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-764168e6-c1f6-4a20-8bca-278e585dd175 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:28.631523 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-764168e6-c1f6-4a20-8bca-278e585dd175 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:28.632340 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-764168e6-c1f6-4a20-8bca-278e585dd175 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:28.632905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-764168e6-c1f6-4a20-8bca-278e585dd175 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:28.671515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-764168e6-c1f6-4a20-8bca-278e585dd175 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Going to try to terminate instance {{(pid=127027) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:39:28.994287 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-764168e6-c1f6-4a20-8bca-278e585dd175 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 204 len: 0 microversion: 2.1 time: 0.377347 Aug 29 20:39:28.996027 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 413/808] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:39:28 2022] DELETE /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:39:29.010072 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-741ef3c8-4268-4c68-aa13-88e304dfb210 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:29.011233 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-741ef3c8-4268-4c68-aa13-88e304dfb210 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:29.023121 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-741ef3c8-4268-4c68-aa13-88e304dfb210 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:29.024460 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-741ef3c8-4268-4c68-aa13-88e304dfb210 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:29.025213 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-741ef3c8-4268-4c68-aa13-88e304dfb210 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:29.026515 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-741ef3c8-4268-4c68-aa13-88e304dfb210 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:29.027800 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-741ef3c8-4268-4c68-aa13-88e304dfb210 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:29.028747 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-741ef3c8-4268-4c68-aa13-88e304dfb210 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:29.598346 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-741ef3c8-4268-4c68-aa13-88e304dfb210 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:29.609666 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-741ef3c8-4268-4c68-aa13-88e304dfb210 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1674 microversion: 2.1 time: 0.607210 Aug 29 20:39:29.610926 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 396/809] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:29 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1674 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:30.576788 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-6da260fe-7609-469a-a0f1-817a9be49e7a req-b665c13f-d3bc-40de-a7e1-caedcc3ac405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570c9c7b-50b9-4879-bb2d-c91da2ead6b5", "tag": "740dee41-866c-4314-89ee-4f035ccd2e9a"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:39:30.594290 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-6da260fe-7609-469a-a0f1-817a9be49e7a req-b665c13f-d3bc-40de-a7e1-caedcc3ac405 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:30.594914 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-6da260fe-7609-469a-a0f1-817a9be49e7a req-b665c13f-d3bc-40de-a7e1-caedcc3ac405 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:30.595457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-6da260fe-7609-469a-a0f1-817a9be49e7a req-b665c13f-d3bc-40de-a7e1-caedcc3ac405 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:30.618993 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-6da260fe-7609-469a-a0f1-817a9be49e7a req-b665c13f-d3bc-40de-a7e1-caedcc3ac405 service nova] Creating event network-changed:740dee41-866c-4314-89ee-4f035ccd2e9a for instance 570c9c7b-50b9-4879-bb2d-c91da2ead6b5 on hv-cinder-85426 Aug 29 20:39:30.627347 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-6da260fe-7609-469a-a0f1-817a9be49e7a req-b665c13f-d3bc-40de-a7e1-caedcc3ac405 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057913 Aug 29 20:39:30.628348 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 414/810] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:39:30.639696 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7c3f8529-ade1-42e2-8b81-fd623d580510 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:30.641243 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7c3f8529-ade1-42e2-8b81-fd623d580510 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:30.649584 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c3f8529-ade1-42e2-8b81-fd623d580510 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:30.650155 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c3f8529-ade1-42e2-8b81-fd623d580510 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:30.650709 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c3f8529-ade1-42e2-8b81-fd623d580510 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:30.651497 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c3f8529-ade1-42e2-8b81-fd623d580510 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:30.651974 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c3f8529-ade1-42e2-8b81-fd623d580510 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:30.652393 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7c3f8529-ade1-42e2-8b81-fd623d580510 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:30.655319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:30.909260 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7c3f8529-ade1-42e2-8b81-fd623d580510 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:30.921918 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7c3f8529-ade1-42e2-8b81-fd623d580510 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1674 microversion: 2.1 time: 0.285694 Aug 29 20:39:30.922966 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 397/811] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:30 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1674 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:31.953880 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6a3c1063-88b6-406d-9cca-beaffeed146d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:31.956160 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6a3c1063-88b6-406d-9cca-beaffeed146d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:31.967917 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:31.971479 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6a3c1063-88b6-406d-9cca-beaffeed146d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:31.979070 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6a3c1063-88b6-406d-9cca-beaffeed146d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:31.979858 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6a3c1063-88b6-406d-9cca-beaffeed146d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:31.980948 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6a3c1063-88b6-406d-9cca-beaffeed146d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:31.981772 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6a3c1063-88b6-406d-9cca-beaffeed146d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:31.982423 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6a3c1063-88b6-406d-9cca-beaffeed146d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:32.201069 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-6a3c1063-88b6-406d-9cca-beaffeed146d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:32.210761 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6a3c1063-88b6-406d-9cca-beaffeed146d tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1674 microversion: 2.1 time: 0.267674 Aug 29 20:39:32.212073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 415/812] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:31 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1674 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:32.644353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-05e77518-e9bc-49e3-9d2f-7f4ae70a4187 req-c2a25208-a393-4bbd-8903-4862019fcf3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe56a6be-788d-44c6-a116-577a344df4c7", "name": "network-vif-deleted", "tag": "9679af1b-9201-413a-8503-93f6d6fc0954"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:39:32.664752 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-05e77518-e9bc-49e3-9d2f-7f4ae70a4187 req-c2a25208-a393-4bbd-8903-4862019fcf3d service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:32.669161 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-05e77518-e9bc-49e3-9d2f-7f4ae70a4187 req-c2a25208-a393-4bbd-8903-4862019fcf3d service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:32.670365 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-05e77518-e9bc-49e3-9d2f-7f4ae70a4187 req-c2a25208-a393-4bbd-8903-4862019fcf3d service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:32.695377 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-05e77518-e9bc-49e3-9d2f-7f4ae70a4187 req-c2a25208-a393-4bbd-8903-4862019fcf3d service nova] Creating event network-vif-deleted:9679af1b-9201-413a-8503-93f6d6fc0954 for instance fe56a6be-788d-44c6-a116-577a344df4c7 on hv-cinder-85426 Aug 29 20:39:32.709021 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-05e77518-e9bc-49e3-9d2f-7f4ae70a4187 req-c2a25208-a393-4bbd-8903-4862019fcf3d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067983 Aug 29 20:39:32.711834 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 398/813] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:39:33.248877 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9719310d-1224-4b37-b824-d478c634715e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:33.250631 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9719310d-1224-4b37-b824-d478c634715e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:33.260655 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9719310d-1224-4b37-b824-d478c634715e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:33.261451 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9719310d-1224-4b37-b824-d478c634715e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:33.262104 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9719310d-1224-4b37-b824-d478c634715e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:33.263166 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9719310d-1224-4b37-b824-d478c634715e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:33.264171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9719310d-1224-4b37-b824-d478c634715e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:33.265282 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9719310d-1224-4b37-b824-d478c634715e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:33.329325 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9719310d-1224-4b37-b824-d478c634715e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:33.330049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9719310d-1224-4b37-b824-d478c634715e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:33.330931 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9719310d-1224-4b37-b824-d478c634715e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:33.331808 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-9719310d-1224-4b37-b824-d478c634715e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lazy-loading 'fault' on Instance uuid fe56a6be-788d-44c6-a116-577a344df4c7 {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:39:33.389374 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9719310d-1224-4b37-b824-d478c634715e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc5854ed52042369a9b153af7da4cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544c78c5c2c44219a7f236b24a107da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:33.402787 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9719310d-1224-4b37-b824-d478c634715e tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 200 len: 1327 microversion: 2.1 time: 0.160475 Aug 29 20:39:33.404905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 416/814] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:33 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 1327 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:39:34.439467 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2161fac3-31ba-4bc2-ab30-5c71a62a8035 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:34.440197 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2161fac3-31ba-4bc2-ab30-5c71a62a8035 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:34.447457 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2161fac3-31ba-4bc2-ab30-5c71a62a8035 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:34.447954 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2161fac3-31ba-4bc2-ab30-5c71a62a8035 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:34.448606 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2161fac3-31ba-4bc2-ab30-5c71a62a8035 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:34.449548 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2161fac3-31ba-4bc2-ab30-5c71a62a8035 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:34.449994 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2161fac3-31ba-4bc2-ab30-5c71a62a8035 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:34.450421 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2161fac3-31ba-4bc2-ab30-5c71a62a8035 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:34.464356 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-2161fac3-31ba-4bc2-ab30-5c71a62a8035 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] HTTP exception thrown: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2161fac3-31ba-4bc2-ab30-5c71a62a8035 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Request method failure captured: Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 HTTP/1.1 Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJ550n0mTWFeCR1Rx2HnjD7cOB8YzZlOIIoAKgjEkfzs28LZlv7QQvwoOS4apX0LYLc9iAPMAsg5ItOhGtlruDL9jr1B_QlZmmmqomvLf_QZccbEpAqP5tVn9H95DHdMq-HPYF087vkEv_81BMd2eoMCvw-XrT-0Yip5DwE8hvX878 Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 544c78c5c2c44219a7f236b24a107da4 Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:39:34.466002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:39:34.467583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_544c78c5c2c44219a7f236b24a107da4"}]}] Aug 29 20:39:34.467583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:34.467583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 544c78c5c2c44219a7f236b24a107da4 Aug 29 20:39:34.467583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:34.467583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-AttachVolumeTestJSON-270891202-project Aug 29 20:39:34.467583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:39:34.467583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:39:34.467583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: adc5854ed52042369a9b153af7da4cfb Aug 29 20:39:34.467583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeTestJSON-270891202-project Aug 29 20:39:34.467583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:39:34.467583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:34.467583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': 'fe56a6be-788d-44c6-a116-577a344df4c7'} Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:39:34.468535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:34.470081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:34.471437 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2161fac3-31ba-4bc2-ab30-5c71a62a8035 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Returning 404 to user: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:39:34.471437 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2161fac3-31ba-4bc2-ab30-5c71a62a8035 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 404 len: 111 microversion: 2.1 time: 0.032569 Aug 29 20:39:34.471437 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 399/815] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:34 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:39:34.477496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1be6e057-cb54-4fe4-bf95-e8aab030a2ca tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '.version_select at 0x7f4863156280>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:34.498106 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1be6e057-cb54-4fe4-bf95-e8aab030a2ca tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212785996" status: 202 len: 0 microversion: 2.1 time: 0.024322 Aug 29 20:39:34.498683 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 417/816] 10.222.0.18 () {58 vars in 1221 bytes} [Mon Aug 29 20:39:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212785996 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:39:37.575873 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3b8e3784-1da9-4be7-bd4c-aee8fc5a9112 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:37.576823 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3b8e3784-1da9-4be7-bd4c-aee8fc5a9112 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:37.587192 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b8e3784-1da9-4be7-bd4c-aee8fc5a9112 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:37.587956 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b8e3784-1da9-4be7-bd4c-aee8fc5a9112 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:37.588627 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b8e3784-1da9-4be7-bd4c-aee8fc5a9112 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:37.592499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b8e3784-1da9-4be7-bd4c-aee8fc5a9112 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:37.592499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b8e3784-1da9-4be7-bd4c-aee8fc5a9112 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:37.592499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b8e3784-1da9-4be7-bd4c-aee8fc5a9112 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:37.613811 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-3b8e3784-1da9-4be7-bd4c-aee8fc5a9112 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] HTTP exception thrown: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3b8e3784-1da9-4be7-bd4c-aee8fc5a9112 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Request method failure captured: Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 HTTP/1.1 Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJ550n0mTWFeCR1Rx2HnjD7cOB8YzZlOIIoAKgjEkfzs28LZlv7QQvwoOS4apX0LYLc9iAPMAsg5ItOhGtlruDL9jr1B_QlZmmmqomvLf_QZccbEpAqP5tVn9H95DHdMq-HPYF087vkEv_81BMd2eoMCvw-XrT-0Yip5DwE8hvX878 Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 544c78c5c2c44219a7f236b24a107da4 Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:39:37.616557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:39:37.619009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_544c78c5c2c44219a7f236b24a107da4"}]}] Aug 29 20:39:37.619009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:37.619009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 544c78c5c2c44219a7f236b24a107da4 Aug 29 20:39:37.619009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:37.619009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-AttachVolumeTestJSON-270891202-project Aug 29 20:39:37.619009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:39:37.619009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:39:37.619009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: adc5854ed52042369a9b153af7da4cfb Aug 29 20:39:37.619009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeTestJSON-270891202-project Aug 29 20:39:37.619009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:39:37.619009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:37.619009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': 'fe56a6be-788d-44c6-a116-577a344df4c7'} Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:39:37.621044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:37.624134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:37.626602 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3b8e3784-1da9-4be7-bd4c-aee8fc5a9112 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Returning 404 to user: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:39:37.626602 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3b8e3784-1da9-4be7-bd4c-aee8fc5a9112 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 404 len: 111 microversion: 2.1 time: 0.049432 Aug 29 20:39:37.626602 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 400/817] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:39:37 2022] DELETE /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:39:37.629250 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-42362da3-57c7-4ac0-b475-e5812ddcdabe tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:37.629929 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-42362da3-57c7-4ac0-b475-e5812ddcdabe tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: fe56a6be-788d-44c6-a116-577a344df4c7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:37.637661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-42362da3-57c7-4ac0-b475-e5812ddcdabe tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:37.638143 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-42362da3-57c7-4ac0-b475-e5812ddcdabe tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:37.638572 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-42362da3-57c7-4ac0-b475-e5812ddcdabe tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:37.639255 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-42362da3-57c7-4ac0-b475-e5812ddcdabe tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:37.639702 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-42362da3-57c7-4ac0-b475-e5812ddcdabe tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:37.640155 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-42362da3-57c7-4ac0-b475-e5812ddcdabe tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:37.655075 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-42362da3-57c7-4ac0-b475-e5812ddcdabe tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] HTTP exception thrown: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-42362da3-57c7-4ac0-b475-e5812ddcdabe tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Request method failure captured: Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 HTTP/1.1 Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSJ550n0mTWFeCR1Rx2HnjD7cOB8YzZlOIIoAKgjEkfzs28LZlv7QQvwoOS4apX0LYLc9iAPMAsg5ItOhGtlruDL9jr1B_QlZmmmqomvLf_QZccbEpAqP5tVn9H95DHdMq-HPYF087vkEv_81BMd2eoMCvw-XrT-0Yip5DwE8hvX878 Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 544c78c5c2c44219a7f236b24a107da4 Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:39:37.656814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:39:37.659096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_544c78c5c2c44219a7f236b24a107da4"}]}] Aug 29 20:39:37.659096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:37.659096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 544c78c5c2c44219a7f236b24a107da4 Aug 29 20:39:37.659096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:37.659096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeTestJSON-270891202-project Aug 29 20:39:37.659096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:39:37.659096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:39:37.659096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: adc5854ed52042369a9b153af7da4cfb Aug 29 20:39:37.659096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeTestJSON-270891202-project Aug 29 20:39:37.659096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:39:37.659096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:37.659096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': 'fe56a6be-788d-44c6-a116-577a344df4c7'} Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:39:37.660498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. Aug 29 20:39:37.662486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:37.664948 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-42362da3-57c7-4ac0-b475-e5812ddcdabe tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Returning 404 to user: Instance fe56a6be-788d-44c6-a116-577a344df4c7 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:39:37.664948 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-42362da3-57c7-4ac0-b475-e5812ddcdabe tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7" status: 404 len: 111 microversion: 2.1 time: 0.032995 Aug 29 20:39:37.664948 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 418/818] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:37 2022] GET /compute/v2.1/servers/fe56a6be-788d-44c6-a116-577a344df4c7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:39:38.851574 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b6e7343-895f-4497-be33-2ed03018a681 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:38.852553 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7b6e7343-895f-4497-be33-2ed03018a681 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:38.860660 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b6e7343-895f-4497-be33-2ed03018a681 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:38.861292 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b6e7343-895f-4497-be33-2ed03018a681 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:38.862041 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b6e7343-895f-4497-be33-2ed03018a681 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:38.863006 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b6e7343-895f-4497-be33-2ed03018a681 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:38.863623 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b6e7343-895f-4497-be33-2ed03018a681 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:38.864194 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b6e7343-895f-4497-be33-2ed03018a681 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:38.882720 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-7b6e7343-895f-4497-be33-2ed03018a681 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] HTTP exception thrown: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b6e7343-895f-4497-be33-2ed03018a681 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Request method failure captured: Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: DELETE /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 HTTP/1.1 Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSJ550n0mTWFeCR1Rx2HnjD7cOB8YzZlOIIoAKgjEkfzs28LZlv7QQvwoOS4apX0LYLc9iAPMAsg5ItOhGtlruDL9jr1B_QlZmmmqomvLf_QZccbEpAqP5tVn9H95DHdMq-HPYF087vkEv_81BMd2eoMCvw-XrT-0Yip5DwE8hvX878 Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 544c78c5c2c44219a7f236b24a107da4 Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:39:38.885239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:39:38.888390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_544c78c5c2c44219a7f236b24a107da4"}]}] Aug 29 20:39:38.888390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:38.888390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 544c78c5c2c44219a7f236b24a107da4 Aug 29 20:39:38.888390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:38.888390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-AttachVolumeTestJSON-270891202-project Aug 29 20:39:38.888390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:39:38.888390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:39:38.888390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: adc5854ed52042369a9b153af7da4cfb Aug 29 20:39:38.888390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeTestJSON-270891202-project Aug 29 20:39:38.888390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:39:38.888390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:39:38.888390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': 'dfdda123-bbf1-425b-b690-2d0919df08a2'} Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:39:38.890528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:39:38.893880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:39:38.898429 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b6e7343-895f-4497-be33-2ed03018a681 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Returning 404 to user: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:39:38.898429 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7b6e7343-895f-4497-be33-2ed03018a681 tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 404 len: 111 microversion: 2.1 time: 0.041427 Aug 29 20:39:38.898429 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 401/819] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:39:38 2022] DELETE /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:39:38.902987 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2d7981ba-5d4b-4761-a17a-cf19656fd7ed tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:38.904180 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2d7981ba-5d4b-4761-a17a-cf19656fd7ed tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] [instance: dfdda123-bbf1-425b-b690-2d0919df08a2] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:38.914512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d7981ba-5d4b-4761-a17a-cf19656fd7ed tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:38.915293 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d7981ba-5d4b-4761-a17a-cf19656fd7ed tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:38.916116 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d7981ba-5d4b-4761-a17a-cf19656fd7ed tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:38.917068 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d7981ba-5d4b-4761-a17a-cf19656fd7ed tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:38.917815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d7981ba-5d4b-4761-a17a-cf19656fd7ed tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:38.918506 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2d7981ba-5d4b-4761-a17a-cf19656fd7ed tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:38.938091 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-2d7981ba-5d4b-4761-a17a-cf19656fd7ed tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] HTTP exception thrown: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2d7981ba-5d4b-4761-a17a-cf19656fd7ed tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Request method failure captured: Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 HTTP/1.1 Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSJ550n0mTWFeCR1Rx2HnjD7cOB8YzZlOIIoAKgjEkfzs28LZlv7QQvwoOS4apX0LYLc9iAPMAsg5ItOhGtlruDL9jr1B_QlZmmmqomvLf_QZccbEpAqP5tVn9H95DHdMq-HPYF087vkEv_81BMd2eoMCvw-XrT-0Yip5DwE8hvX878 Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 544c78c5c2c44219a7f236b24a107da4 Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:39:38.940131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:39:38.942722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/544c78c5c2c44219a7f236b24a107da4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_544c78c5c2c44219a7f236b24a107da4"}]}] Aug 29 20:39:38.942722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:38.942722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 544c78c5c2c44219a7f236b24a107da4 Aug 29 20:39:38.942722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270891202 Aug 29 20:39:38.942722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeTestJSON-270891202-project Aug 29 20:39:38.942722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:39:38.942722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:39:38.942722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: adc5854ed52042369a9b153af7da4cfb Aug 29 20:39:38.942722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeTestJSON-270891202-project Aug 29 20:39:38.942722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:39:38.942722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:39:38.942722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': 'dfdda123-bbf1-425b-b690-2d0919df08a2'} Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:39:38.944194 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. Aug 29 20:39:38.947171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:38.949669 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2d7981ba-5d4b-4761-a17a-cf19656fd7ed tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] Returning 404 to user: Instance dfdda123-bbf1-425b-b690-2d0919df08a2 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:39:38.949669 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2d7981ba-5d4b-4761-a17a-cf19656fd7ed tempest-AttachVolumeTestJSON-270891202 tempest-AttachVolumeTestJSON-270891202-project] 10.222.0.18 "GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2" status: 404 len: 111 microversion: 2.1 time: 0.045028 Aug 29 20:39:38.949669 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 419/820] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:39:38 2022] GET /compute/v2.1/servers/dfdda123-bbf1-425b-b690-2d0919df08a2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:39:39.457359 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d15d9462-e690-4ca1-b0bc-87de7af89227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:39.458255 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d15d9462-e690-4ca1-b0bc-87de7af89227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:39.469201 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d15d9462-e690-4ca1-b0bc-87de7af89227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:39.469201 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d15d9462-e690-4ca1-b0bc-87de7af89227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:39.470053 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d15d9462-e690-4ca1-b0bc-87de7af89227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:39.470615 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d15d9462-e690-4ca1-b0bc-87de7af89227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:39.472066 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d15d9462-e690-4ca1-b0bc-87de7af89227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:39.472793 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d15d9462-e690-4ca1-b0bc-87de7af89227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:39.535289 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d15d9462-e690-4ca1-b0bc-87de7af89227 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea/ips" status: 200 len: 151 microversion: 2.20 time: 0.084428 Aug 29 20:39:39.536757 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 402/821] 10.222.0.18 () {60 vars in 1289 bytes} [Mon Aug 29 20:39:39 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea/ips => generated 151 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:39:41.574548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-06bf011a-746c-4fb5-ad2c-8c90163a6f07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:39:41.575687 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-06bf011a-746c-4fb5-ad2c-8c90163a6f07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:41.583427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-06bf011a-746c-4fb5-ad2c-8c90163a6f07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:41.584336 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-06bf011a-746c-4fb5-ad2c-8c90163a6f07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:41.586576 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-06bf011a-746c-4fb5-ad2c-8c90163a6f07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:41.588171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-06bf011a-746c-4fb5-ad2c-8c90163a6f07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:41.590486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-06bf011a-746c-4fb5-ad2c-8c90163a6f07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:41.591075 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-06bf011a-746c-4fb5-ad2c-8c90163a6f07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:41.662617 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-06bf011a-746c-4fb5-ad2c-8c90163a6f07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lazy-loading 'flavor' on Instance uuid bb8c3779-360e-43b6-8c43-50a3008159ea {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:39:42.094702 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-06bf011a-746c-4fb5-ad2c-8c90163a6f07 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "POST /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea/action" status: 202 len: 0 microversion: 2.20 time: 0.525801 Aug 29 20:39:42.098686 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 420/822] 10.222.0.18 () {62 vars in 1319 bytes} [Mon Aug 29 20:39:41 2022] POST /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:39:42.110885 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6186ebe9-afad-4d54-8ae2-e57d65b0b2e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:42.113237 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6186ebe9-afad-4d54-8ae2-e57d65b0b2e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:42.129642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6186ebe9-afad-4d54-8ae2-e57d65b0b2e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:42.130809 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6186ebe9-afad-4d54-8ae2-e57d65b0b2e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:42.132156 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6186ebe9-afad-4d54-8ae2-e57d65b0b2e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:42.134156 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6186ebe9-afad-4d54-8ae2-e57d65b0b2e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:42.135169 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6186ebe9-afad-4d54-8ae2-e57d65b0b2e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:42.136168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6186ebe9-afad-4d54-8ae2-e57d65b0b2e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:42.494499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6186ebe9-afad-4d54-8ae2-e57d65b0b2e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:42.514504 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6186ebe9-afad-4d54-8ae2-e57d65b0b2e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:42.519199 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6186ebe9-afad-4d54-8ae2-e57d65b0b2e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:42.523234 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6186ebe9-afad-4d54-8ae2-e57d65b0b2e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1724 microversion: 2.20 time: 0.420698 Aug 29 20:39:42.528274 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 403/823] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:39:42 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1724 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:39:43.575987 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8c84af01-54d6-4f2d-8110-c0a015e0fbe1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:43.577908 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8c84af01-54d6-4f2d-8110-c0a015e0fbe1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:43.613136 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c84af01-54d6-4f2d-8110-c0a015e0fbe1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:43.614316 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c84af01-54d6-4f2d-8110-c0a015e0fbe1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:43.615404 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c84af01-54d6-4f2d-8110-c0a015e0fbe1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:43.616896 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c84af01-54d6-4f2d-8110-c0a015e0fbe1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:43.617965 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c84af01-54d6-4f2d-8110-c0a015e0fbe1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:43.619969 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c84af01-54d6-4f2d-8110-c0a015e0fbe1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:43.659806 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:43.925041 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8c84af01-54d6-4f2d-8110-c0a015e0fbe1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:43.940295 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8c84af01-54d6-4f2d-8110-c0a015e0fbe1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:43.943037 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8c84af01-54d6-4f2d-8110-c0a015e0fbe1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:43.945300 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8c84af01-54d6-4f2d-8110-c0a015e0fbe1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1724 microversion: 2.20 time: 0.380726 Aug 29 20:39:43.946628 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 421/824] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:39:43 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:39:44.983750 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf17aaa1-aec1-4702-89eb-a8271548339b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:44.984925 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf17aaa1-aec1-4702-89eb-a8271548339b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:44.995235 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf17aaa1-aec1-4702-89eb-a8271548339b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:44.996072 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf17aaa1-aec1-4702-89eb-a8271548339b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:44.997100 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf17aaa1-aec1-4702-89eb-a8271548339b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:44.998329 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf17aaa1-aec1-4702-89eb-a8271548339b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:44.999064 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf17aaa1-aec1-4702-89eb-a8271548339b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:44.999764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf17aaa1-aec1-4702-89eb-a8271548339b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:45.198417 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf17aaa1-aec1-4702-89eb-a8271548339b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:45.206921 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf17aaa1-aec1-4702-89eb-a8271548339b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:45.208399 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf17aaa1-aec1-4702-89eb-a8271548339b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:45.209592 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf17aaa1-aec1-4702-89eb-a8271548339b tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1724 microversion: 2.20 time: 0.230884 Aug 29 20:39:45.210166 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 404/825] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:39:44 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:39:45.426715 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-15c99000-5e7f-41fa-9a7d-ae2bbc0c4519 tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] Action: 'create', calling method: .version_select at 0x7f48631560d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1188326385", "metadata": {"Type": "work"}}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:39:45.790223 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-15c99000-5e7f-41fa-9a7d-ae2bbc0c4519 tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.486912 Aug 29 20:39:45.791139 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 422/826] 10.222.0.18 () {60 vars in 1156 bytes} [Mon Aug 29 20:39:45 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 489 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 20:39:45.803475 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6161c98e-4e06-4948-84e9-38aa505d0a1c tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] Calling method '.version_select at 0x7f486316e5e0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:45.868151 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6161c98e-4e06-4948-84e9-38aa505d0a1c tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/18b14896-a03e-4e83-ac4f-9b665b1e0614" status: 200 len: 353 microversion: 2.1 time: 0.068256 Aug 29 20:39:45.868822 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 405/827] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:39:45 2022] GET /compute/v2.1/os-volumes/18b14896-a03e-4e83-ac4f-9b665b1e0614 => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:39:46.469311 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-84c388c7-514f-4139-9355-3cad870637fd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:46.469934 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-84c388c7-514f-4139-9355-3cad870637fd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:46.477723 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-84c388c7-514f-4139-9355-3cad870637fd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:46.478239 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-84c388c7-514f-4139-9355-3cad870637fd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:46.478719 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-84c388c7-514f-4139-9355-3cad870637fd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:46.479486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-84c388c7-514f-4139-9355-3cad870637fd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:46.480016 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-84c388c7-514f-4139-9355-3cad870637fd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:46.480470 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-84c388c7-514f-4139-9355-3cad870637fd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:46.672640 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-84c388c7-514f-4139-9355-3cad870637fd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:46.683582 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-84c388c7-514f-4139-9355-3cad870637fd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:46.687595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-84c388c7-514f-4139-9355-3cad870637fd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:46.689897 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-84c388c7-514f-4139-9355-3cad870637fd tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1724 microversion: 2.20 time: 0.446300 Aug 29 20:39:46.690927 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 423/828] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:39:46 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1724 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:39:46.883254 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7269c093-699e-49f1-8514-1aa2d1a422e7 tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] Calling method '.version_select at 0x7f486347fee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:46.941155 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7269c093-699e-49f1-8514-1aa2d1a422e7 tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/18b14896-a03e-4e83-ac4f-9b665b1e0614" status: 200 len: 354 microversion: 2.1 time: 0.062279 Aug 29 20:39:46.941731 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 406/829] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:39:46 2022] GET /compute/v2.1/os-volumes/18b14896-a03e-4e83-ac4f-9b665b1e0614 => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:39:46.954725 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-66e3507b-7955-4b5c-a4a3-f462f8331ebd tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] Calling method '.version_select at 0x7f48631b2c10>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:47.018658 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-66e3507b-7955-4b5c-a4a3-f462f8331ebd tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/18b14896-a03e-4e83-ac4f-9b665b1e0614" status: 200 len: 354 microversion: 2.1 time: 0.067750 Aug 29 20:39:47.019217 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 424/830] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:39:46 2022] GET /compute/v2.1/os-volumes/18b14896-a03e-4e83-ac4f-9b665b1e0614 => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:39:47.045484 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7cd11a11-cfcf-43b6-8195-c1514ae0fbb6 tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] Calling method '.version_select at 0x7f486333c280>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:47.127144 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7cd11a11-cfcf-43b6-8195-c1514ae0fbb6 tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/18b14896-a03e-4e83-ac4f-9b665b1e0614" status: 202 len: 0 microversion: 2.1 time: 0.085958 Aug 29 20:39:47.127769 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 407/831] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 29 20:39:47 2022] DELETE /compute/v2.1/os-volumes/18b14896-a03e-4e83-ac4f-9b665b1e0614 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:39:47.137351 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-55a1173c-b5e4-4b99-b858-290367677e1f tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] Calling method '.version_select at 0x7f4863136700>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:47.196413 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-55a1173c-b5e4-4b99-b858-290367677e1f tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/18b14896-a03e-4e83-ac4f-9b665b1e0614" status: 200 len: 353 microversion: 2.1 time: 0.063481 Aug 29 20:39:47.201646 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 425/832] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:39:47 2022] GET /compute/v2.1/os-volumes/18b14896-a03e-4e83-ac4f-9b665b1e0614 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:39:47.713580 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf696535-3173-4926-a005-64ab0f99efe9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:47.714290 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf696535-3173-4926-a005-64ab0f99efe9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:47.722140 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf696535-3173-4926-a005-64ab0f99efe9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:47.722792 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf696535-3173-4926-a005-64ab0f99efe9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:47.723292 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf696535-3173-4926-a005-64ab0f99efe9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:47.724478 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf696535-3173-4926-a005-64ab0f99efe9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:47.725016 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf696535-3173-4926-a005-64ab0f99efe9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:47.725635 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf696535-3173-4926-a005-64ab0f99efe9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:48.214477 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b485bdba-5507-4cf6-84df-d1a1130e60cd tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] Calling method '.version_select at 0x7f486322e430>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:48.224988 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf696535-3173-4926-a005-64ab0f99efe9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:48.241729 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf696535-3173-4926-a005-64ab0f99efe9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:48.243832 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf696535-3173-4926-a005-64ab0f99efe9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:48.245124 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf696535-3173-4926-a005-64ab0f99efe9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1724 microversion: 2.20 time: 0.535929 Aug 29 20:39:48.249169 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 408/833] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:39:47 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1724 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:39:48.270041 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-b485bdba-5507-4cf6-84df-d1a1130e60cd tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] HTTP exception thrown: Volume 18b14896-a03e-4e83-ac4f-9b665b1e0614 could not be found. Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b485bdba-5507-4cf6-84df-d1a1130e60cd tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] Request method failure captured: Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/os-volumes/18b14896-a03e-4e83-ac4f-9b665b1e0614 HTTP/1.1 Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSQR1MzXgfToqZqOFFVW6MphKqICyWtSik7yn6y7y58Zr1hYscccySZsG7beIdaQvzoRnWAQ5Zb9iVUB58drZcAkUcPQtLYnkcAPJsJZMQXFKbpqmq2LqrV9o1DY0sjEckdrNp7nmk0atVKS7xVJbYSVEyPBsFFE5UmjnCCWqgmzXTs Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: cabee0f9db4b41abba9fced3cf293eb9 Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-VolumesGetTestJSON-524144978 Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:39:48.272469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:39:48.274253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cabee0f9db4b41abba9fced3cf293eb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cabee0f9db4b41abba9fced3cf293eb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cabee0f9db4b41abba9fced3cf293eb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cabee0f9db4b41abba9fced3cf293eb9"}]}] Aug 29 20:39:48.274253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-VolumesGetTestJSON-524144978 Aug 29 20:39:48.274253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: cabee0f9db4b41abba9fced3cf293eb9 Aug 29 20:39:48.274253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-VolumesGetTestJSON-524144978 Aug 29 20:39:48.274253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-VolumesGetTestJSON-524144978-project Aug 29 20:39:48.274253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:39:48.274253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:39:48.274253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: a004d6c41d1140819d1470f7035f9317 Aug 29 20:39:48.274253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-VolumesGetTestJSON-524144978-project Aug 29 20:39:48.274253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: Aug 29 20:39:48.274253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Volume 18b14896-a03e-4e83-ac4f-9b665b1e0614 could not be found. Aug 29 20:39:48.274253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '18b14896-a03e-4e83-ac4f-9b665b1e0614'} Aug 29 20:39:48.274253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18b14896-a03e-4e83-ac4f-9b665b1e0614 could not be found. (HTTP 404) (Request-ID: req-faee9fb3-ddab-4d38-9118-16cc8b2465d0) Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:48.275419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 20:39:48.276957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18b14896-a03e-4e83-ac4f-9b665b1e0614 could not be found. Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 20:39:48.281488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:39:48.284125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18b14896-a03e-4e83-ac4f-9b665b1e0614 could not be found. Aug 29 20:39:48.284125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:48.284125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:39:48.284125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:48.284125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:39:48.284125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:39:48.284125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:39:48.284125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:39:48.284125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:39:48.284125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18b14896-a03e-4e83-ac4f-9b665b1e0614 could not be found. Aug 29 20:39:48.284125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:39:48.284125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b485bdba-5507-4cf6-84df-d1a1130e60cd tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] Returning 404 to user: Volume 18b14896-a03e-4e83-ac4f-9b665b1e0614 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:39:48.284125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b485bdba-5507-4cf6-84df-d1a1130e60cd tempest-VolumesGetTestJSON-524144978 tempest-VolumesGetTestJSON-524144978-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/18b14896-a03e-4e83-ac4f-9b665b1e0614" status: 404 len: 109 microversion: 2.1 time: 0.067070 Aug 29 20:39:48.284125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 426/834] 10.222.0.18 () {58 vars in 1245 bytes} [Mon Aug 29 20:39:48 2022] GET /compute/v2.1/os-volumes/18b14896-a03e-4e83-ac4f-9b665b1e0614 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:39:49.277251 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e50640b8-5b73-43dc-869d-856552f30a70 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:49.278171 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e50640b8-5b73-43dc-869d-856552f30a70 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:49.290385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e50640b8-5b73-43dc-869d-856552f30a70 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:49.291413 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e50640b8-5b73-43dc-869d-856552f30a70 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:49.292378 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e50640b8-5b73-43dc-869d-856552f30a70 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:49.293711 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e50640b8-5b73-43dc-869d-856552f30a70 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:49.297422 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e50640b8-5b73-43dc-869d-856552f30a70 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:49.298209 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e50640b8-5b73-43dc-869d-856552f30a70 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:49.532853 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e50640b8-5b73-43dc-869d-856552f30a70 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:49.555571 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e50640b8-5b73-43dc-869d-856552f30a70 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:49.557269 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-e50640b8-5b73-43dc-869d-856552f30a70 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:49.559713 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e50640b8-5b73-43dc-869d-856552f30a70 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1724 microversion: 2.20 time: 0.287836 Aug 29 20:39:49.566364 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 409/835] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:39:49 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:39:50.599145 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-aa35af8f-7bba-48e4-9b91-54ade5c4b5c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:50.600210 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-aa35af8f-7bba-48e4-9b91-54ade5c4b5c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:50.610396 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-aa35af8f-7bba-48e4-9b91-54ade5c4b5c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:50.611178 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-aa35af8f-7bba-48e4-9b91-54ade5c4b5c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:50.611897 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-aa35af8f-7bba-48e4-9b91-54ade5c4b5c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:50.613083 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-aa35af8f-7bba-48e4-9b91-54ade5c4b5c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:50.613831 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-aa35af8f-7bba-48e4-9b91-54ade5c4b5c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:50.614502 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-aa35af8f-7bba-48e4-9b91-54ade5c4b5c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:50.833936 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-aa35af8f-7bba-48e4-9b91-54ade5c4b5c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:50.846890 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-aa35af8f-7bba-48e4-9b91-54ade5c4b5c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:50.849016 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-aa35af8f-7bba-48e4-9b91-54ade5c4b5c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:50.850708 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-aa35af8f-7bba-48e4-9b91-54ade5c4b5c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1724 microversion: 2.20 time: 0.259116 Aug 29 20:39:50.852213 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 427/836] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:39:50 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:39:51.879510 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8f2323d5-3335-480d-81db-5d34d865543c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:51.880734 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8f2323d5-3335-480d-81db-5d34d865543c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:51.892003 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f2323d5-3335-480d-81db-5d34d865543c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:51.893110 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f2323d5-3335-480d-81db-5d34d865543c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:51.894173 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f2323d5-3335-480d-81db-5d34d865543c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:51.895498 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f2323d5-3335-480d-81db-5d34d865543c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:51.896464 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f2323d5-3335-480d-81db-5d34d865543c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:51.897348 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8f2323d5-3335-480d-81db-5d34d865543c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:52.094715 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8f2323d5-3335-480d-81db-5d34d865543c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:52.107044 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8f2323d5-3335-480d-81db-5d34d865543c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:52.108916 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8f2323d5-3335-480d-81db-5d34d865543c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:52.123412 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8f2323d5-3335-480d-81db-5d34d865543c tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1724 microversion: 2.20 time: 0.250258 Aug 29 20:39:52.125421 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 410/837] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:39:51 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:39:53.155260 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-55571d5c-b5c0-41c7-95a9-e0c85980cc03 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:53.155957 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-55571d5c-b5c0-41c7-95a9-e0c85980cc03 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:53.162473 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-55571d5c-b5c0-41c7-95a9-e0c85980cc03 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:53.162988 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-55571d5c-b5c0-41c7-95a9-e0c85980cc03 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:53.163392 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-55571d5c-b5c0-41c7-95a9-e0c85980cc03 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:53.164663 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-55571d5c-b5c0-41c7-95a9-e0c85980cc03 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:53.165116 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-55571d5c-b5c0-41c7-95a9-e0c85980cc03 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:53.165542 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-55571d5c-b5c0-41c7-95a9-e0c85980cc03 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:53.309284 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-55571d5c-b5c0-41c7-95a9-e0c85980cc03 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:53.317965 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-55571d5c-b5c0-41c7-95a9-e0c85980cc03 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:53.319398 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-55571d5c-b5c0-41c7-95a9-e0c85980cc03 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:53.321101 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-55571d5c-b5c0-41c7-95a9-e0c85980cc03 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1724 microversion: 2.20 time: 0.169825 Aug 29 20:39:53.321651 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 428/838] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:39:53 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 20:39:54.345274 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-169e3b6f-5fd7-420a-8288-3f331cee9e3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:54.345869 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-169e3b6f-5fd7-420a-8288-3f331cee9e3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:54.353046 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-169e3b6f-5fd7-420a-8288-3f331cee9e3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:54.353582 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-169e3b6f-5fd7-420a-8288-3f331cee9e3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:54.354109 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-169e3b6f-5fd7-420a-8288-3f331cee9e3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:54.354977 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-169e3b6f-5fd7-420a-8288-3f331cee9e3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:54.355490 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-169e3b6f-5fd7-420a-8288-3f331cee9e3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:54.356012 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-169e3b6f-5fd7-420a-8288-3f331cee9e3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:54.493842 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-169e3b6f-5fd7-420a-8288-3f331cee9e3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:54.502454 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-169e3b6f-5fd7-420a-8288-3f331cee9e3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:54.503877 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-169e3b6f-5fd7-420a-8288-3f331cee9e3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:54.505066 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-169e3b6f-5fd7-420a-8288-3f331cee9e3a tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1724 microversion: 2.20 time: 0.163783 Aug 29 20:39:54.505618 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 411/839] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:39:54 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:39:55.542572 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7ee0ab43-3cc2-4f3b-9d20-f8c68f2aa62d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:55.544007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7ee0ab43-3cc2-4f3b-9d20-f8c68f2aa62d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:55.554927 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ee0ab43-3cc2-4f3b-9d20-f8c68f2aa62d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:55.555799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ee0ab43-3cc2-4f3b-9d20-f8c68f2aa62d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:55.556825 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ee0ab43-3cc2-4f3b-9d20-f8c68f2aa62d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:55.558068 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ee0ab43-3cc2-4f3b-9d20-f8c68f2aa62d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:55.558901 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ee0ab43-3cc2-4f3b-9d20-f8c68f2aa62d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:55.559975 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ee0ab43-3cc2-4f3b-9d20-f8c68f2aa62d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:55.764462 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7ee0ab43-3cc2-4f3b-9d20-f8c68f2aa62d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:55.774940 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7ee0ab43-3cc2-4f3b-9d20-f8c68f2aa62d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:55.776913 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7ee0ab43-3cc2-4f3b-9d20-f8c68f2aa62d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:55.778511 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7ee0ab43-3cc2-4f3b-9d20-f8c68f2aa62d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1724 microversion: 2.20 time: 0.243957 Aug 29 20:39:55.779582 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 429/840] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:39:55 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:39:56.807465 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-60a5dda8-ef79-4c14-973a-7a92ae154bb0 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:56.808758 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-60a5dda8-ef79-4c14-973a-7a92ae154bb0 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:56.812318 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=34 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:56.824017 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60a5dda8-ef79-4c14-973a-7a92ae154bb0 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:56.824596 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60a5dda8-ef79-4c14-973a-7a92ae154bb0 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:56.825087 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60a5dda8-ef79-4c14-973a-7a92ae154bb0 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:56.825906 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60a5dda8-ef79-4c14-973a-7a92ae154bb0 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:56.826414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60a5dda8-ef79-4c14-973a-7a92ae154bb0 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:56.826917 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-60a5dda8-ef79-4c14-973a-7a92ae154bb0 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:56.989907 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-60a5dda8-ef79-4c14-973a-7a92ae154bb0 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:56.999760 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-60a5dda8-ef79-4c14-973a-7a92ae154bb0 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:57.001414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-60a5dda8-ef79-4c14-973a-7a92ae154bb0 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:57.003410 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-60a5dda8-ef79-4c14-973a-7a92ae154bb0 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1724 microversion: 2.20 time: 0.201050 Aug 29 20:39:57.004288 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 412/841] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:39:56 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:39:58.032238 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-da073156-5f77-4971-a7a8-73d7592c057f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:58.034241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-da073156-5f77-4971-a7a8-73d7592c057f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:58.044085 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da073156-5f77-4971-a7a8-73d7592c057f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:58.044909 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da073156-5f77-4971-a7a8-73d7592c057f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:58.045893 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da073156-5f77-4971-a7a8-73d7592c057f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:58.046904 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da073156-5f77-4971-a7a8-73d7592c057f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:58.047877 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da073156-5f77-4971-a7a8-73d7592c057f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:58.048460 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-da073156-5f77-4971-a7a8-73d7592c057f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:58.221294 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-da073156-5f77-4971-a7a8-73d7592c057f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:58.241132 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-da073156-5f77-4971-a7a8-73d7592c057f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:58.244084 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-da073156-5f77-4971-a7a8-73d7592c057f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:58.247082 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-da073156-5f77-4971-a7a8-73d7592c057f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1745 microversion: 2.20 time: 0.221731 Aug 29 20:39:58.248019 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 430/842] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:39:58 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1745 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:39:59.274327 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5524983d-dc21-424a-930a-462f45225aea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:39:59.275076 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5524983d-dc21-424a-930a-462f45225aea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:39:59.281782 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5524983d-dc21-424a-930a-462f45225aea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:59.282272 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5524983d-dc21-424a-930a-462f45225aea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:59.282715 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5524983d-dc21-424a-930a-462f45225aea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:59.283466 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5524983d-dc21-424a-930a-462f45225aea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:39:59.284014 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5524983d-dc21-424a-930a-462f45225aea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:39:59.291856 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5524983d-dc21-424a-930a-462f45225aea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:39:59.710878 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5524983d-dc21-424a-930a-462f45225aea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:59.730630 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5524983d-dc21-424a-930a-462f45225aea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:59.735774 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5524983d-dc21-424a-930a-462f45225aea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:39:59.742033 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5524983d-dc21-424a-930a-462f45225aea tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1745 microversion: 2.20 time: 0.471492 Aug 29 20:39:59.757681 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 413/843] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:39:59 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1745 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:00.792629 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d6333123-2431-4e30-b5a4-6bc2e9f4fce2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:00.794638 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d6333123-2431-4e30-b5a4-6bc2e9f4fce2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:00.811124 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6333123-2431-4e30-b5a4-6bc2e9f4fce2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:00.813419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6333123-2431-4e30-b5a4-6bc2e9f4fce2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:00.814931 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6333123-2431-4e30-b5a4-6bc2e9f4fce2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:00.816542 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6333123-2431-4e30-b5a4-6bc2e9f4fce2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:00.817667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6333123-2431-4e30-b5a4-6bc2e9f4fce2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:00.818727 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6333123-2431-4e30-b5a4-6bc2e9f4fce2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:01.133056 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d6333123-2431-4e30-b5a4-6bc2e9f4fce2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:01.148680 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d6333123-2431-4e30-b5a4-6bc2e9f4fce2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:01.151364 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d6333123-2431-4e30-b5a4-6bc2e9f4fce2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:01.156732 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d6333123-2431-4e30-b5a4-6bc2e9f4fce2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1740 microversion: 2.20 time: 0.376591 Aug 29 20:40:01.157759 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 431/844] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:00 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1740 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:01.642025 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-8cdd9679-4a73-4437-896e-64d5c97890f5 req-0d75f538-ca01-44eb-8d38-cf611ed67d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8c3779-360e-43b6-8c43-50a3008159ea", "name": "network-vif-plugged", "status": "completed", "tag": "13477485-5060-4306-b273-b24627558f04"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:40:01.659973 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8cdd9679-4a73-4437-896e-64d5c97890f5 req-0d75f538-ca01-44eb-8d38-cf611ed67d60 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:01.661408 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8cdd9679-4a73-4437-896e-64d5c97890f5 req-0d75f538-ca01-44eb-8d38-cf611ed67d60 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:01.664222 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8cdd9679-4a73-4437-896e-64d5c97890f5 req-0d75f538-ca01-44eb-8d38-cf611ed67d60 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:01.687237 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=66 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:01.692380 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-8cdd9679-4a73-4437-896e-64d5c97890f5 req-0d75f538-ca01-44eb-8d38-cf611ed67d60 service nova] Creating event network-vif-plugged:13477485-5060-4306-b273-b24627558f04 for instance bb8c3779-360e-43b6-8c43-50a3008159ea on hv-cinder-85426 Aug 29 20:40:01.698152 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-8cdd9679-4a73-4437-896e-64d5c97890f5 req-0d75f538-ca01-44eb-8d38-cf611ed67d60 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060758 Aug 29 20:40:01.699340 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 414/845] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:40:02.200620 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-35ca8fd0-5290-4ac3-a837-cd41854eeb60 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:02.203185 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-35ca8fd0-5290-4ac3-a837-cd41854eeb60 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:02.232153 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:02.240070 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-35ca8fd0-5290-4ac3-a837-cd41854eeb60 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:02.243485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-35ca8fd0-5290-4ac3-a837-cd41854eeb60 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:02.244499 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-35ca8fd0-5290-4ac3-a837-cd41854eeb60 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:02.246310 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-35ca8fd0-5290-4ac3-a837-cd41854eeb60 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:02.247961 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-35ca8fd0-5290-4ac3-a837-cd41854eeb60 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:02.248941 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-35ca8fd0-5290-4ac3-a837-cd41854eeb60 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:02.593872 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-35ca8fd0-5290-4ac3-a837-cd41854eeb60 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:02.624793 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-35ca8fd0-5290-4ac3-a837-cd41854eeb60 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:02.627577 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-35ca8fd0-5290-4ac3-a837-cd41854eeb60 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:02.630491 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-35ca8fd0-5290-4ac3-a837-cd41854eeb60 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1740 microversion: 2.20 time: 0.438927 Aug 29 20:40:02.632781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 432/846] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:02 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1740 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:03.670849 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c85a568e-b80d-4fde-bcdc-47bdf7eb3325 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:03.671926 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c85a568e-b80d-4fde-bcdc-47bdf7eb3325 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:03.683344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c85a568e-b80d-4fde-bcdc-47bdf7eb3325 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:03.684532 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c85a568e-b80d-4fde-bcdc-47bdf7eb3325 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:03.685394 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c85a568e-b80d-4fde-bcdc-47bdf7eb3325 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:03.686525 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c85a568e-b80d-4fde-bcdc-47bdf7eb3325 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:03.688018 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c85a568e-b80d-4fde-bcdc-47bdf7eb3325 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:03.688483 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c85a568e-b80d-4fde-bcdc-47bdf7eb3325 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:03.926016 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c85a568e-b80d-4fde-bcdc-47bdf7eb3325 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:03.936185 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c85a568e-b80d-4fde-bcdc-47bdf7eb3325 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:03.938163 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-c85a568e-b80d-4fde-bcdc-47bdf7eb3325 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:03.939725 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c85a568e-b80d-4fde-bcdc-47bdf7eb3325 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1740 microversion: 2.20 time: 0.276585 Aug 29 20:40:03.940557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 415/847] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:03 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:04.964827 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-235c9373-5ca2-44b0-8f1f-fff986dad377 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:04.972342 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-235c9373-5ca2-44b0-8f1f-fff986dad377 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:04.980436 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-235c9373-5ca2-44b0-8f1f-fff986dad377 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:04.980933 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-235c9373-5ca2-44b0-8f1f-fff986dad377 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:04.981369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-235c9373-5ca2-44b0-8f1f-fff986dad377 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:04.982500 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-235c9373-5ca2-44b0-8f1f-fff986dad377 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:04.983296 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-235c9373-5ca2-44b0-8f1f-fff986dad377 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:04.984720 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-235c9373-5ca2-44b0-8f1f-fff986dad377 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:05.193454 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-235c9373-5ca2-44b0-8f1f-fff986dad377 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:05.244842 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-235c9373-5ca2-44b0-8f1f-fff986dad377 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:05.250271 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-235c9373-5ca2-44b0-8f1f-fff986dad377 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:05.253498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-235c9373-5ca2-44b0-8f1f-fff986dad377 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1740 microversion: 2.20 time: 0.294661 Aug 29 20:40:05.256131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 433/848] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:04 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:06.295436 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae2bc23c-b7e2-4677-b3af-f17e012c507f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:06.296782 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ae2bc23c-b7e2-4677-b3af-f17e012c507f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:06.307915 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae2bc23c-b7e2-4677-b3af-f17e012c507f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:06.308443 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae2bc23c-b7e2-4677-b3af-f17e012c507f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:06.308861 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae2bc23c-b7e2-4677-b3af-f17e012c507f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:06.313102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae2bc23c-b7e2-4677-b3af-f17e012c507f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:06.313773 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae2bc23c-b7e2-4677-b3af-f17e012c507f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:06.314208 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae2bc23c-b7e2-4677-b3af-f17e012c507f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:06.518025 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae2bc23c-b7e2-4677-b3af-f17e012c507f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:06.531378 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae2bc23c-b7e2-4677-b3af-f17e012c507f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:06.533277 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ae2bc23c-b7e2-4677-b3af-f17e012c507f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:06.535687 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ae2bc23c-b7e2-4677-b3af-f17e012c507f tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1740 microversion: 2.20 time: 0.244643 Aug 29 20:40:06.536499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 416/849] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:06 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:07.570353 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-953fb7d5-fc8d-4544-acb2-359298ecc20d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:07.572100 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-953fb7d5-fc8d-4544-acb2-359298ecc20d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:07.581695 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-953fb7d5-fc8d-4544-acb2-359298ecc20d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:07.582590 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-953fb7d5-fc8d-4544-acb2-359298ecc20d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:07.583250 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-953fb7d5-fc8d-4544-acb2-359298ecc20d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:07.584210 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-953fb7d5-fc8d-4544-acb2-359298ecc20d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:07.585241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-953fb7d5-fc8d-4544-acb2-359298ecc20d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:07.585833 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-953fb7d5-fc8d-4544-acb2-359298ecc20d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:07.762059 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-953fb7d5-fc8d-4544-acb2-359298ecc20d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:07.770814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-953fb7d5-fc8d-4544-acb2-359298ecc20d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:07.772312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-953fb7d5-fc8d-4544-acb2-359298ecc20d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:07.773808 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-953fb7d5-fc8d-4544-acb2-359298ecc20d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1740 microversion: 2.20 time: 0.217064 Aug 29 20:40:07.774580 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 434/850] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:07 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:08.807518 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bde28ca7-c8d8-4ce0-ac79-5c678ee62334 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:08.808821 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bde28ca7-c8d8-4ce0-ac79-5c678ee62334 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:08.816890 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde28ca7-c8d8-4ce0-ac79-5c678ee62334 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:08.817797 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde28ca7-c8d8-4ce0-ac79-5c678ee62334 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:08.818433 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde28ca7-c8d8-4ce0-ac79-5c678ee62334 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:08.819969 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde28ca7-c8d8-4ce0-ac79-5c678ee62334 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:08.820624 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde28ca7-c8d8-4ce0-ac79-5c678ee62334 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:08.821256 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bde28ca7-c8d8-4ce0-ac79-5c678ee62334 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:08.966136 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bde28ca7-c8d8-4ce0-ac79-5c678ee62334 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:08.977688 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bde28ca7-c8d8-4ce0-ac79-5c678ee62334 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:08.979060 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bde28ca7-c8d8-4ce0-ac79-5c678ee62334 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:08.980508 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bde28ca7-c8d8-4ce0-ac79-5c678ee62334 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1740 microversion: 2.20 time: 0.177727 Aug 29 20:40:08.987991 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 417/851] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:08 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:10.003514 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-64de6c05-a748-4332-9252-5c74f076b05e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:10.004295 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-64de6c05-a748-4332-9252-5c74f076b05e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:10.011778 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-64de6c05-a748-4332-9252-5c74f076b05e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:10.012322 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-64de6c05-a748-4332-9252-5c74f076b05e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:10.013094 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-64de6c05-a748-4332-9252-5c74f076b05e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:10.013893 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-64de6c05-a748-4332-9252-5c74f076b05e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:10.014659 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-64de6c05-a748-4332-9252-5c74f076b05e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:10.015227 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-64de6c05-a748-4332-9252-5c74f076b05e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:10.180090 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-64de6c05-a748-4332-9252-5c74f076b05e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:10.189741 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-64de6c05-a748-4332-9252-5c74f076b05e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:10.191468 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-64de6c05-a748-4332-9252-5c74f076b05e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:10.192709 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-64de6c05-a748-4332-9252-5c74f076b05e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1740 microversion: 2.20 time: 0.193451 Aug 29 20:40:10.193625 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 435/852] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:09 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:11.217802 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4f567dbb-039b-46de-b57c-e587a5673c85 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:11.218417 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4f567dbb-039b-46de-b57c-e587a5673c85 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:11.226286 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f567dbb-039b-46de-b57c-e587a5673c85 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:11.226778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f567dbb-039b-46de-b57c-e587a5673c85 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:11.228075 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f567dbb-039b-46de-b57c-e587a5673c85 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:11.228514 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f567dbb-039b-46de-b57c-e587a5673c85 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:11.228938 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f567dbb-039b-46de-b57c-e587a5673c85 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:11.229440 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4f567dbb-039b-46de-b57c-e587a5673c85 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:11.377202 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-4f567dbb-039b-46de-b57c-e587a5673c85 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:11.389710 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-4f567dbb-039b-46de-b57c-e587a5673c85 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:11.391441 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-4f567dbb-039b-46de-b57c-e587a5673c85 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:11.392671 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4f567dbb-039b-46de-b57c-e587a5673c85 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1740 microversion: 2.20 time: 0.179296 Aug 29 20:40:11.404335 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 418/853] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:11 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:12.419582 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-743730bd-80e4-429d-a6e7-97f9636eca78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:12.420350 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-743730bd-80e4-429d-a6e7-97f9636eca78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:12.426996 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-743730bd-80e4-429d-a6e7-97f9636eca78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:12.427481 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-743730bd-80e4-429d-a6e7-97f9636eca78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:12.427923 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-743730bd-80e4-429d-a6e7-97f9636eca78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:12.428736 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-743730bd-80e4-429d-a6e7-97f9636eca78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:12.429223 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-743730bd-80e4-429d-a6e7-97f9636eca78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:12.429645 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-743730bd-80e4-429d-a6e7-97f9636eca78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:12.581311 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-743730bd-80e4-429d-a6e7-97f9636eca78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:12.590219 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-743730bd-80e4-429d-a6e7-97f9636eca78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:12.591694 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-743730bd-80e4-429d-a6e7-97f9636eca78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:12.593432 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-743730bd-80e4-429d-a6e7-97f9636eca78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1740 microversion: 2.20 time: 0.177449 Aug 29 20:40:12.593432 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 436/854] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:12 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:13.618420 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7b908a08-deae-4e61-b096-bcff53467c2e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:13.619034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7b908a08-deae-4e61-b096-bcff53467c2e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:13.625676 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b908a08-deae-4e61-b096-bcff53467c2e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:13.626167 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b908a08-deae-4e61-b096-bcff53467c2e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:13.626635 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b908a08-deae-4e61-b096-bcff53467c2e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:13.627429 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b908a08-deae-4e61-b096-bcff53467c2e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:13.627893 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b908a08-deae-4e61-b096-bcff53467c2e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:13.628385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7b908a08-deae-4e61-b096-bcff53467c2e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:13.766437 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7b908a08-deae-4e61-b096-bcff53467c2e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:13.774486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7b908a08-deae-4e61-b096-bcff53467c2e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:13.775909 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7b908a08-deae-4e61-b096-bcff53467c2e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:13.777074 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7b908a08-deae-4e61-b096-bcff53467c2e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1722 microversion: 2.20 time: 0.163249 Aug 29 20:40:13.777636 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 419/855] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:13 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:14.800107 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b1e1d191-bd99-42bf-b54b-ab44932da9d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:14.800728 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b1e1d191-bd99-42bf-b54b-ab44932da9d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:14.807848 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b1e1d191-bd99-42bf-b54b-ab44932da9d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:14.808370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b1e1d191-bd99-42bf-b54b-ab44932da9d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:14.808803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b1e1d191-bd99-42bf-b54b-ab44932da9d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:14.809757 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b1e1d191-bd99-42bf-b54b-ab44932da9d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:14.810206 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b1e1d191-bd99-42bf-b54b-ab44932da9d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:14.810630 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b1e1d191-bd99-42bf-b54b-ab44932da9d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:14.813398 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=72 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:14.952312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b1e1d191-bd99-42bf-b54b-ab44932da9d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:14.961048 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b1e1d191-bd99-42bf-b54b-ab44932da9d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:14.962486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b1e1d191-bd99-42bf-b54b-ab44932da9d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:14.963668 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b1e1d191-bd99-42bf-b54b-ab44932da9d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1722 microversion: 2.20 time: 0.167528 Aug 29 20:40:14.964259 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 437/856] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:14 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:15.684127 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-dbbccb7f-0ba6-469f-8fdc-18692883eb90 req-48ee97d2-2a8d-42cc-b6cd-4d0c3dafb720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8c3779-360e-43b6-8c43-50a3008159ea", "name": "network-vif-unplugged", "status": "completed", "tag": "13477485-5060-4306-b273-b24627558f04"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:40:15.695414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-dbbccb7f-0ba6-469f-8fdc-18692883eb90 req-48ee97d2-2a8d-42cc-b6cd-4d0c3dafb720 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:15.695967 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-dbbccb7f-0ba6-469f-8fdc-18692883eb90 req-48ee97d2-2a8d-42cc-b6cd-4d0c3dafb720 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:15.696346 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-dbbccb7f-0ba6-469f-8fdc-18692883eb90 req-48ee97d2-2a8d-42cc-b6cd-4d0c3dafb720 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:15.709070 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-dbbccb7f-0ba6-469f-8fdc-18692883eb90 req-48ee97d2-2a8d-42cc-b6cd-4d0c3dafb720 service nova] Creating event network-vif-unplugged:13477485-5060-4306-b273-b24627558f04 for instance bb8c3779-360e-43b6-8c43-50a3008159ea on hv-cinder-85426 Aug 29 20:40:15.714788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-dbbccb7f-0ba6-469f-8fdc-18692883eb90 req-48ee97d2-2a8d-42cc-b6cd-4d0c3dafb720 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034307 Aug 29 20:40:15.715389 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 420/857] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:40:15.986671 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-5bbe0e14-5112-4213-bc2a-a9e73a0b05e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:15.987286 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-5bbe0e14-5112-4213-bc2a-a9e73a0b05e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:15.994489 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5bbe0e14-5112-4213-bc2a-a9e73a0b05e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:15.994989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5bbe0e14-5112-4213-bc2a-a9e73a0b05e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:15.995458 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5bbe0e14-5112-4213-bc2a-a9e73a0b05e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:15.996208 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5bbe0e14-5112-4213-bc2a-a9e73a0b05e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:15.996667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5bbe0e14-5112-4213-bc2a-a9e73a0b05e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:15.997091 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5bbe0e14-5112-4213-bc2a-a9e73a0b05e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:16.133635 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-5bbe0e14-5112-4213-bc2a-a9e73a0b05e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:16.142539 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-5bbe0e14-5112-4213-bc2a-a9e73a0b05e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:16.144001 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-5bbe0e14-5112-4213-bc2a-a9e73a0b05e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:16.145205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-5bbe0e14-5112-4213-bc2a-a9e73a0b05e2 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1665 microversion: 2.20 time: 0.162453 Aug 29 20:40:16.145767 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 438/858] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:15 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1665 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:16.169290 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f3003667-b86c-46cd-b1ea-d25f830fc025 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d392a97-e16f-4071-b26e-256bfdc0c129"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:40:16.171961 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f3003667-b86c-46cd-b1ea-d25f830fc025 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:16.178113 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3003667-b86c-46cd-b1ea-d25f830fc025 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:16.179093 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3003667-b86c-46cd-b1ea-d25f830fc025 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:16.179523 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3003667-b86c-46cd-b1ea-d25f830fc025 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:16.180243 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3003667-b86c-46cd-b1ea-d25f830fc025 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:16.180686 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3003667-b86c-46cd-b1ea-d25f830fc025 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:16.181100 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f3003667-b86c-46cd-b1ea-d25f830fc025 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:16.461535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f3003667-b86c-46cd-b1ea-d25f830fc025 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "POST /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297548 Aug 29 20:40:16.462147 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 421/859] 10.222.0.18 () {62 vars in 1364 bytes} [Mon Aug 29 20:40:16 2022] POST /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 20:40:16.589381 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-61e76eeb-1b2c-4c16-9da2-95e60ab9eadc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:16.589873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-61e76eeb-1b2c-4c16-9da2-95e60ab9eadc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:16.596377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61e76eeb-1b2c-4c16-9da2-95e60ab9eadc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:16.596868 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61e76eeb-1b2c-4c16-9da2-95e60ab9eadc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:16.597304 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61e76eeb-1b2c-4c16-9da2-95e60ab9eadc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:16.598038 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61e76eeb-1b2c-4c16-9da2-95e60ab9eadc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:16.598493 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61e76eeb-1b2c-4c16-9da2-95e60ab9eadc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:16.598919 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-61e76eeb-1b2c-4c16-9da2-95e60ab9eadc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:16.847077 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-61e76eeb-1b2c-4c16-9da2-95e60ab9eadc tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea/os-volume_attachments/5d392a97-e16f-4071-b26e-256bfdc0c129" status: 202 len: 0 microversion: 2.20 time: 0.262320 Aug 29 20:40:16.847631 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 439/860] 10.222.0.18 () {60 vars in 1457 bytes} [Mon Aug 29 20:40:16 2022] DELETE /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea/os-volume_attachments/5d392a97-e16f-4071-b26e-256bfdc0c129 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:40:16.907127 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2431d3bd-95e5-411a-b9c6-b0a06531acce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:40:16.907723 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2431d3bd-95e5-411a-b9c6-b0a06531acce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:16.915567 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2431d3bd-95e5-411a-b9c6-b0a06531acce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:16.916084 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2431d3bd-95e5-411a-b9c6-b0a06531acce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:16.916524 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2431d3bd-95e5-411a-b9c6-b0a06531acce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:16.917220 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2431d3bd-95e5-411a-b9c6-b0a06531acce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:16.917672 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2431d3bd-95e5-411a-b9c6-b0a06531acce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:16.918093 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2431d3bd-95e5-411a-b9c6-b0a06531acce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:16.948077 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2431d3bd-95e5-411a-b9c6-b0a06531acce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127028) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 20:40:17.013587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2431d3bd-95e5-411a-b9c6-b0a06531acce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "POST /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea/action" status: 202 len: 0 microversion: 2.20 time: 0.110337 Aug 29 20:40:17.014112 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 422/861] 10.222.0.18 () {62 vars in 1319 bytes} [Mon Aug 29 20:40:16 2022] POST /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:40:17.022908 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-500fe89c-ea2d-472b-b1a2-f5f8d68b4257 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:17.023608 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-500fe89c-ea2d-472b-b1a2-f5f8d68b4257 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:17.031368 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-500fe89c-ea2d-472b-b1a2-f5f8d68b4257 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:17.032091 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-500fe89c-ea2d-472b-b1a2-f5f8d68b4257 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:17.032540 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-500fe89c-ea2d-472b-b1a2-f5f8d68b4257 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:17.033249 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-500fe89c-ea2d-472b-b1a2-f5f8d68b4257 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:17.033702 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-500fe89c-ea2d-472b-b1a2-f5f8d68b4257 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:17.034129 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-500fe89c-ea2d-472b-b1a2-f5f8d68b4257 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:17.177745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-500fe89c-ea2d-472b-b1a2-f5f8d68b4257 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:17.186463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-500fe89c-ea2d-472b-b1a2-f5f8d68b4257 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:17.187907 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-500fe89c-ea2d-472b-b1a2-f5f8d68b4257 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:17.189147 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-500fe89c-ea2d-472b-b1a2-f5f8d68b4257 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1673 microversion: 2.20 time: 0.170862 Aug 29 20:40:17.189723 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 440/862] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:17 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:18.212547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-97f0729f-ebfa-4388-8451-af646f8316d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:18.213181 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-97f0729f-ebfa-4388-8451-af646f8316d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:18.219208 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97f0729f-ebfa-4388-8451-af646f8316d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:18.219694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97f0729f-ebfa-4388-8451-af646f8316d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:18.220160 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97f0729f-ebfa-4388-8451-af646f8316d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:18.220854 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97f0729f-ebfa-4388-8451-af646f8316d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:18.221306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97f0729f-ebfa-4388-8451-af646f8316d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:18.221732 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-97f0729f-ebfa-4388-8451-af646f8316d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:18.382410 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-97f0729f-ebfa-4388-8451-af646f8316d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:18.390971 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-97f0729f-ebfa-4388-8451-af646f8316d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:18.392491 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-97f0729f-ebfa-4388-8451-af646f8316d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:18.393716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-97f0729f-ebfa-4388-8451-af646f8316d6 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.185614 Aug 29 20:40:18.394291 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 423/863] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:18 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:19.422338 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8784eeb0-1e35-42fa-ae75-d0e8813d2aed tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:19.424009 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8784eeb0-1e35-42fa-ae75-d0e8813d2aed tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:19.440335 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8784eeb0-1e35-42fa-ae75-d0e8813d2aed tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:19.441157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8784eeb0-1e35-42fa-ae75-d0e8813d2aed tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:19.441953 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8784eeb0-1e35-42fa-ae75-d0e8813d2aed tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:19.443047 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8784eeb0-1e35-42fa-ae75-d0e8813d2aed tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:19.443920 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8784eeb0-1e35-42fa-ae75-d0e8813d2aed tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:19.445195 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8784eeb0-1e35-42fa-ae75-d0e8813d2aed tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:19.621999 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8784eeb0-1e35-42fa-ae75-d0e8813d2aed tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:19.631722 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8784eeb0-1e35-42fa-ae75-d0e8813d2aed tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:19.634176 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8784eeb0-1e35-42fa-ae75-d0e8813d2aed tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:19.636284 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8784eeb0-1e35-42fa-ae75-d0e8813d2aed tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.218785 Aug 29 20:40:19.648933 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 441/864] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:19 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:20.661148 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2fbc0c81-9f83-44ee-ae73-f4efe81c0a86 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:20.661754 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2fbc0c81-9f83-44ee-ae73-f4efe81c0a86 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:20.668240 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fbc0c81-9f83-44ee-ae73-f4efe81c0a86 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:20.668717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fbc0c81-9f83-44ee-ae73-f4efe81c0a86 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:20.669151 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fbc0c81-9f83-44ee-ae73-f4efe81c0a86 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:20.669838 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fbc0c81-9f83-44ee-ae73-f4efe81c0a86 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:20.670286 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fbc0c81-9f83-44ee-ae73-f4efe81c0a86 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:20.670710 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2fbc0c81-9f83-44ee-ae73-f4efe81c0a86 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:20.836254 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-2fbc0c81-9f83-44ee-ae73-f4efe81c0a86 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:20.845903 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-2fbc0c81-9f83-44ee-ae73-f4efe81c0a86 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:20.847445 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-2fbc0c81-9f83-44ee-ae73-f4efe81c0a86 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:20.848660 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2fbc0c81-9f83-44ee-ae73-f4efe81c0a86 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.191390 Aug 29 20:40:20.849221 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 424/865] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:20 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:21.878754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-69e90cf5-0775-4379-a6b4-34856bb7dce7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:21.880787 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-69e90cf5-0775-4379-a6b4-34856bb7dce7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:21.894231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-69e90cf5-0775-4379-a6b4-34856bb7dce7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:21.895091 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-69e90cf5-0775-4379-a6b4-34856bb7dce7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:21.895857 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-69e90cf5-0775-4379-a6b4-34856bb7dce7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:21.897134 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-69e90cf5-0775-4379-a6b4-34856bb7dce7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:21.898497 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-69e90cf5-0775-4379-a6b4-34856bb7dce7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:21.898964 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-69e90cf5-0775-4379-a6b4-34856bb7dce7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:22.041786 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-69e90cf5-0775-4379-a6b4-34856bb7dce7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:22.050092 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-69e90cf5-0775-4379-a6b4-34856bb7dce7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:22.051524 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-69e90cf5-0775-4379-a6b4-34856bb7dce7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:22.052803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-69e90cf5-0775-4379-a6b4-34856bb7dce7 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.182029 Aug 29 20:40:22.053354 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 442/866] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:21 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:23.077883 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3b75d8ec-c150-4e36-971a-ad6af8c03221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:23.078410 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3b75d8ec-c150-4e36-971a-ad6af8c03221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:23.087414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b75d8ec-c150-4e36-971a-ad6af8c03221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:23.088360 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b75d8ec-c150-4e36-971a-ad6af8c03221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:23.089010 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b75d8ec-c150-4e36-971a-ad6af8c03221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:23.089935 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b75d8ec-c150-4e36-971a-ad6af8c03221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:23.090582 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b75d8ec-c150-4e36-971a-ad6af8c03221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:23.091220 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3b75d8ec-c150-4e36-971a-ad6af8c03221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:23.252307 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3b75d8ec-c150-4e36-971a-ad6af8c03221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:23.261902 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3b75d8ec-c150-4e36-971a-ad6af8c03221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:23.263630 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3b75d8ec-c150-4e36-971a-ad6af8c03221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:23.265038 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3b75d8ec-c150-4e36-971a-ad6af8c03221 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.193337 Aug 29 20:40:23.276776 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 425/867] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:23 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:24.292524 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-763b9d5f-4cef-4f0c-ba93-fee3a2d6e1e8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:24.294347 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-763b9d5f-4cef-4f0c-ba93-fee3a2d6e1e8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:24.306578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-763b9d5f-4cef-4f0c-ba93-fee3a2d6e1e8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:24.306578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-763b9d5f-4cef-4f0c-ba93-fee3a2d6e1e8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:24.306578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-763b9d5f-4cef-4f0c-ba93-fee3a2d6e1e8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:24.306578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-763b9d5f-4cef-4f0c-ba93-fee3a2d6e1e8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:24.307101 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-763b9d5f-4cef-4f0c-ba93-fee3a2d6e1e8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:24.307101 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-763b9d5f-4cef-4f0c-ba93-fee3a2d6e1e8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:24.464884 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-763b9d5f-4cef-4f0c-ba93-fee3a2d6e1e8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:24.473258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-763b9d5f-4cef-4f0c-ba93-fee3a2d6e1e8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:24.474710 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-763b9d5f-4cef-4f0c-ba93-fee3a2d6e1e8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:24.476514 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-763b9d5f-4cef-4f0c-ba93-fee3a2d6e1e8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.188683 Aug 29 20:40:24.477177 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 443/868] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:24 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:25.498947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-36ee2a8e-1fae-4880-8d97-3310e060d5bf tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:25.499523 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-36ee2a8e-1fae-4880-8d97-3310e060d5bf tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:25.505995 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36ee2a8e-1fae-4880-8d97-3310e060d5bf tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:25.506472 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36ee2a8e-1fae-4880-8d97-3310e060d5bf tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:25.507404 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36ee2a8e-1fae-4880-8d97-3310e060d5bf tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:25.508110 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36ee2a8e-1fae-4880-8d97-3310e060d5bf tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:25.508562 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36ee2a8e-1fae-4880-8d97-3310e060d5bf tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:25.508988 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-36ee2a8e-1fae-4880-8d97-3310e060d5bf tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:25.642981 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-36ee2a8e-1fae-4880-8d97-3310e060d5bf tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:25.653390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-36ee2a8e-1fae-4880-8d97-3310e060d5bf tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:25.655235 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-36ee2a8e-1fae-4880-8d97-3310e060d5bf tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:25.656816 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-36ee2a8e-1fae-4880-8d97-3310e060d5bf tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.162031 Aug 29 20:40:25.671091 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 426/869] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:25 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:26.680939 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-134748cb-9a96-4ce6-b595-21e47fd9e8b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:26.681488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-134748cb-9a96-4ce6-b595-21e47fd9e8b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:26.687853 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-134748cb-9a96-4ce6-b595-21e47fd9e8b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:26.688381 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-134748cb-9a96-4ce6-b595-21e47fd9e8b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:26.688820 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-134748cb-9a96-4ce6-b595-21e47fd9e8b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:26.689516 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-134748cb-9a96-4ce6-b595-21e47fd9e8b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:26.689972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-134748cb-9a96-4ce6-b595-21e47fd9e8b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:26.690394 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-134748cb-9a96-4ce6-b595-21e47fd9e8b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:26.832223 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-134748cb-9a96-4ce6-b595-21e47fd9e8b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:26.841619 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-134748cb-9a96-4ce6-b595-21e47fd9e8b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:26.843064 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-134748cb-9a96-4ce6-b595-21e47fd9e8b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:26.844290 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-134748cb-9a96-4ce6-b595-21e47fd9e8b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.167616 Aug 29 20:40:26.845141 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 444/870] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:26 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:27.869098 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a4586ed6-c546-4c2b-9d28-6d70b147dbce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:27.869828 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a4586ed6-c546-4c2b-9d28-6d70b147dbce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:27.872371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:27.877995 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4586ed6-c546-4c2b-9d28-6d70b147dbce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:27.878470 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4586ed6-c546-4c2b-9d28-6d70b147dbce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:27.878898 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4586ed6-c546-4c2b-9d28-6d70b147dbce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:27.879587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4586ed6-c546-4c2b-9d28-6d70b147dbce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:27.880065 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4586ed6-c546-4c2b-9d28-6d70b147dbce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:27.880482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a4586ed6-c546-4c2b-9d28-6d70b147dbce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:28.025046 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a4586ed6-c546-4c2b-9d28-6d70b147dbce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:28.034375 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a4586ed6-c546-4c2b-9d28-6d70b147dbce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:28.035834 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a4586ed6-c546-4c2b-9d28-6d70b147dbce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:28.037031 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a4586ed6-c546-4c2b-9d28-6d70b147dbce tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.172445 Aug 29 20:40:28.039129 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 427/871] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:27 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:29.073179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-303e11a3-1248-4abd-a33a-cd4dd26f6de8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:29.073827 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-303e11a3-1248-4abd-a33a-cd4dd26f6de8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:29.080248 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-303e11a3-1248-4abd-a33a-cd4dd26f6de8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:29.080761 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-303e11a3-1248-4abd-a33a-cd4dd26f6de8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:29.081582 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-303e11a3-1248-4abd-a33a-cd4dd26f6de8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:29.081866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-303e11a3-1248-4abd-a33a-cd4dd26f6de8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:29.082312 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-303e11a3-1248-4abd-a33a-cd4dd26f6de8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:29.082730 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-303e11a3-1248-4abd-a33a-cd4dd26f6de8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:29.212668 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-303e11a3-1248-4abd-a33a-cd4dd26f6de8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:29.221951 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-303e11a3-1248-4abd-a33a-cd4dd26f6de8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:29.223738 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-303e11a3-1248-4abd-a33a-cd4dd26f6de8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:29.224974 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-303e11a3-1248-4abd-a33a-cd4dd26f6de8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.156493 Aug 29 20:40:29.225732 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 445/872] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:29 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:30.249191 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-873dd481-fd9d-4d58-864f-5bc94ff502e4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:30.249815 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-873dd481-fd9d-4d58-864f-5bc94ff502e4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:30.256206 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-873dd481-fd9d-4d58-864f-5bc94ff502e4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:30.256686 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-873dd481-fd9d-4d58-864f-5bc94ff502e4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:30.257141 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-873dd481-fd9d-4d58-864f-5bc94ff502e4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:30.257829 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-873dd481-fd9d-4d58-864f-5bc94ff502e4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:30.258279 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-873dd481-fd9d-4d58-864f-5bc94ff502e4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:30.258773 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-873dd481-fd9d-4d58-864f-5bc94ff502e4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:30.273980 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:30.392880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-873dd481-fd9d-4d58-864f-5bc94ff502e4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:30.402190 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-873dd481-fd9d-4d58-864f-5bc94ff502e4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:30.403656 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-873dd481-fd9d-4d58-864f-5bc94ff502e4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:30.404850 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-873dd481-fd9d-4d58-864f-5bc94ff502e4 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.159568 Aug 29 20:40:30.405460 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 428/873] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:30 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:31.429295 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b6ad634c-2ac4-4ae5-9538-e9f932c16989 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:31.430371 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b6ad634c-2ac4-4ae5-9538-e9f932c16989 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:31.437168 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b6ad634c-2ac4-4ae5-9538-e9f932c16989 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:31.437643 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b6ad634c-2ac4-4ae5-9538-e9f932c16989 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:31.438101 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b6ad634c-2ac4-4ae5-9538-e9f932c16989 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:31.438772 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b6ad634c-2ac4-4ae5-9538-e9f932c16989 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:31.439223 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b6ad634c-2ac4-4ae5-9538-e9f932c16989 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:31.439647 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b6ad634c-2ac4-4ae5-9538-e9f932c16989 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:31.572172 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b6ad634c-2ac4-4ae5-9538-e9f932c16989 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:31.580368 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b6ad634c-2ac4-4ae5-9538-e9f932c16989 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:31.581815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b6ad634c-2ac4-4ae5-9538-e9f932c16989 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:31.582986 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b6ad634c-2ac4-4ae5-9538-e9f932c16989 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.157786 Aug 29 20:40:31.583548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 446/874] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:31 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:32.605125 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ad87f93-2f24-45d5-99e5-c7ae1d8da7c1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:32.605658 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ad87f93-2f24-45d5-99e5-c7ae1d8da7c1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:32.611530 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ad87f93-2f24-45d5-99e5-c7ae1d8da7c1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:32.612037 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ad87f93-2f24-45d5-99e5-c7ae1d8da7c1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:32.612471 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ad87f93-2f24-45d5-99e5-c7ae1d8da7c1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:32.613157 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ad87f93-2f24-45d5-99e5-c7ae1d8da7c1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:32.613609 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ad87f93-2f24-45d5-99e5-c7ae1d8da7c1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:32.614025 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ad87f93-2f24-45d5-99e5-c7ae1d8da7c1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:32.740614 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ad87f93-2f24-45d5-99e5-c7ae1d8da7c1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:32.749244 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ad87f93-2f24-45d5-99e5-c7ae1d8da7c1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:32.750670 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8ad87f93-2f24-45d5-99e5-c7ae1d8da7c1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:32.751822 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ad87f93-2f24-45d5-99e5-c7ae1d8da7c1 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.150914 Aug 29 20:40:32.752421 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 429/875] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:32 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:33.775710 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1de75c11-a1d4-4203-aa8a-d8701be9a7c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:33.776378 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1de75c11-a1d4-4203-aa8a-d8701be9a7c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:33.779969 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=30 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:33.786815 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1de75c11-a1d4-4203-aa8a-d8701be9a7c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:33.787479 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1de75c11-a1d4-4203-aa8a-d8701be9a7c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:33.788059 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1de75c11-a1d4-4203-aa8a-d8701be9a7c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:33.789278 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1de75c11-a1d4-4203-aa8a-d8701be9a7c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:33.789821 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1de75c11-a1d4-4203-aa8a-d8701be9a7c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:33.790639 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1de75c11-a1d4-4203-aa8a-d8701be9a7c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:33.949447 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1de75c11-a1d4-4203-aa8a-d8701be9a7c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:33.958481 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1de75c11-a1d4-4203-aa8a-d8701be9a7c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:33.960212 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1de75c11-a1d4-4203-aa8a-d8701be9a7c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:33.962104 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1de75c11-a1d4-4203-aa8a-d8701be9a7c3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.190587 Aug 29 20:40:33.963054 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 447/876] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:33 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:34.029810 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-c057790e-abd2-4061-ad56-686c4b96dedb req-40522f9e-c270-4840-87e2-15b84d9696da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8c3779-360e-43b6-8c43-50a3008159ea", "name": "network-vif-plugged", "status": "completed", "tag": "13477485-5060-4306-b273-b24627558f04"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:40:34.042792 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c057790e-abd2-4061-ad56-686c4b96dedb req-40522f9e-c270-4840-87e2-15b84d9696da service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:34.044547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c057790e-abd2-4061-ad56-686c4b96dedb req-40522f9e-c270-4840-87e2-15b84d9696da service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:34.044547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-c057790e-abd2-4061-ad56-686c4b96dedb req-40522f9e-c270-4840-87e2-15b84d9696da service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:34.056192 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-c057790e-abd2-4061-ad56-686c4b96dedb req-40522f9e-c270-4840-87e2-15b84d9696da service nova] Creating event network-vif-plugged:13477485-5060-4306-b273-b24627558f04 for instance bb8c3779-360e-43b6-8c43-50a3008159ea on hv-cinder-85426 Aug 29 20:40:34.063152 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-c057790e-abd2-4061-ad56-686c4b96dedb req-40522f9e-c270-4840-87e2-15b84d9696da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036750 Aug 29 20:40:34.064434 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 430/877] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:40:34.985428 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9783468c-0a77-4788-af3c-af50a1daacf3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:34.986059 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9783468c-0a77-4788-af3c-af50a1daacf3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:34.992657 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9783468c-0a77-4788-af3c-af50a1daacf3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:34.993135 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9783468c-0a77-4788-af3c-af50a1daacf3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:34.993573 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9783468c-0a77-4788-af3c-af50a1daacf3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:34.994273 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9783468c-0a77-4788-af3c-af50a1daacf3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:34.994728 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9783468c-0a77-4788-af3c-af50a1daacf3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:34.995153 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9783468c-0a77-4788-af3c-af50a1daacf3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:35.143058 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9783468c-0a77-4788-af3c-af50a1daacf3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:35.152473 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9783468c-0a77-4788-af3c-af50a1daacf3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:35.154242 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9783468c-0a77-4788-af3c-af50a1daacf3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:35.155511 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9783468c-0a77-4788-af3c-af50a1daacf3 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.174063 Aug 29 20:40:35.156090 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 448/878] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:34 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:36.179703 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-678f6fe1-474e-46fb-9323-928c192af7af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:36.181576 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-678f6fe1-474e-46fb-9323-928c192af7af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:36.189441 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-678f6fe1-474e-46fb-9323-928c192af7af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:36.189920 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-678f6fe1-474e-46fb-9323-928c192af7af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:36.190548 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-678f6fe1-474e-46fb-9323-928c192af7af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:36.191438 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-678f6fe1-474e-46fb-9323-928c192af7af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:36.191890 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-678f6fe1-474e-46fb-9323-928c192af7af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:36.192338 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-678f6fe1-474e-46fb-9323-928c192af7af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:36.360895 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-678f6fe1-474e-46fb-9323-928c192af7af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:36.372437 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-678f6fe1-474e-46fb-9323-928c192af7af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:36.373895 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-678f6fe1-474e-46fb-9323-928c192af7af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:36.375263 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-678f6fe1-474e-46fb-9323-928c192af7af tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1731 microversion: 2.20 time: 0.200027 Aug 29 20:40:36.375918 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 431/879] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:36 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1731 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:37.404542 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-47996215-831d-4195-aae0-bacfaa90db83 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:37.405336 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-47996215-831d-4195-aae0-bacfaa90db83 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:37.412215 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47996215-831d-4195-aae0-bacfaa90db83 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:37.412703 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47996215-831d-4195-aae0-bacfaa90db83 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:37.413139 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47996215-831d-4195-aae0-bacfaa90db83 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:37.413841 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47996215-831d-4195-aae0-bacfaa90db83 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:37.415226 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47996215-831d-4195-aae0-bacfaa90db83 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:37.415662 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47996215-831d-4195-aae0-bacfaa90db83 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:37.546770 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-47996215-831d-4195-aae0-bacfaa90db83 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:37.555108 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-47996215-831d-4195-aae0-bacfaa90db83 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:37.556579 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-47996215-831d-4195-aae0-bacfaa90db83 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:37.557785 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-47996215-831d-4195-aae0-bacfaa90db83 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1718 microversion: 2.20 time: 0.157282 Aug 29 20:40:37.558339 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 449/880] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:40:37 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:40:48.416204 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-792939516", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "networks": [{"uuid": "aabb81f8-a301-47ad-a66b-a8659a1137e5"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:40:48.425129 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=9 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:48.425796 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=17 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:48.473970 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] validate_networks() for [('aabb81f8-a301-47ad-a66b-a8659a1137e5', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:40:48.834414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:40:48.834792 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:40:48.835314 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:40:48.835718 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:40:48.836177 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:40:48.845054 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:48.845538 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:48.845974 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:48.846702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:48.847155 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:48.847606 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:48.864591 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Getting quotas for project 732a8a55dfbd44afa826eb6f5571aabf. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:40:48.869137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Getting quotas for user 037a2fa230a840cbaf876540632aeafa and project 732a8a55dfbd44afa826eb6f5571aabf. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:40:48.879913 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:40:48.882199 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:40:48.928855 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-752db3a1-ae5b-4667-bfe2-ec574216b350 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516962 Aug 29 20:40:48.929706 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 432/881] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:40:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:40:48.940967 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-81fabc75-b422-4b27-b5eb-08ca1fec413d tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:48.941590 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-81fabc75-b422-4b27-b5eb-08ca1fec413d tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:48.944074 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=5 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:48.944739 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:49.003085 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-81fabc75-b422-4b27-b5eb-08ca1fec413d tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:49.010475 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-81fabc75-b422-4b27-b5eb-08ca1fec413d tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 200 len: 1218 microversion: 2.1 time: 0.073331 Aug 29 20:40:49.011276 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 450/882] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:48 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:50.031509 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b9afebfc-c95a-4f37-9a8c-604593db306c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:50.032143 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b9afebfc-c95a-4f37-9a8c-604593db306c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:50.038843 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9afebfc-c95a-4f37-9a8c-604593db306c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:50.039321 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9afebfc-c95a-4f37-9a8c-604593db306c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:50.040357 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9afebfc-c95a-4f37-9a8c-604593db306c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:50.041095 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9afebfc-c95a-4f37-9a8c-604593db306c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:50.041549 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9afebfc-c95a-4f37-9a8c-604593db306c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:50.042020 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b9afebfc-c95a-4f37-9a8c-604593db306c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:50.119966 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-b9afebfc-c95a-4f37-9a8c-604593db306c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:50.127643 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b9afebfc-c95a-4f37-9a8c-604593db306c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 200 len: 1270 microversion: 2.1 time: 0.100442 Aug 29 20:40:50.128247 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 433/883] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:50 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:51.148587 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-987b4e84-79aa-4b0b-be4b-446f3a8ae272 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:51.149304 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-987b4e84-79aa-4b0b-be4b-446f3a8ae272 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:51.158774 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-987b4e84-79aa-4b0b-be4b-446f3a8ae272 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:51.159257 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-987b4e84-79aa-4b0b-be4b-446f3a8ae272 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:51.159684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-987b4e84-79aa-4b0b-be4b-446f3a8ae272 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:51.160415 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-987b4e84-79aa-4b0b-be4b-446f3a8ae272 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:51.160864 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-987b4e84-79aa-4b0b-be4b-446f3a8ae272 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:51.161279 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-987b4e84-79aa-4b0b-be4b-446f3a8ae272 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:51.300544 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-987b4e84-79aa-4b0b-be4b-446f3a8ae272 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:51.312844 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-987b4e84-79aa-4b0b-be4b-446f3a8ae272 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 200 len: 1318 microversion: 2.1 time: 0.167335 Aug 29 20:40:51.314023 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 451/884] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:51 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:51.350694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-0d9caf4b-9204-45cd-8579-c43ee379eebd req-c26ea748-7eec-4e8b-9321-4268eabae589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f00e48-ce6f-46e3-9c3f-843ad53c1e17", "tag": "965dfd7e-6945-4afe-8e3c-f9f76a73a0ae"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:40:51.362116 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0d9caf4b-9204-45cd-8579-c43ee379eebd req-c26ea748-7eec-4e8b-9321-4268eabae589 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:51.362593 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0d9caf4b-9204-45cd-8579-c43ee379eebd req-c26ea748-7eec-4e8b-9321-4268eabae589 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:51.363054 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-0d9caf4b-9204-45cd-8579-c43ee379eebd req-c26ea748-7eec-4e8b-9321-4268eabae589 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:51.375546 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-0d9caf4b-9204-45cd-8579-c43ee379eebd req-c26ea748-7eec-4e8b-9321-4268eabae589 service nova] Creating event network-changed:965dfd7e-6945-4afe-8e3c-f9f76a73a0ae for instance 73f00e48-ce6f-46e3-9c3f-843ad53c1e17 on hv-cinder-85426 Aug 29 20:40:51.380539 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-0d9caf4b-9204-45cd-8579-c43ee379eebd req-c26ea748-7eec-4e8b-9321-4268eabae589 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033963 Aug 29 20:40:51.381505 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 434/885] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:40:52.333361 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4d54b465-96e0-49b8-9cb3-232a3634cc5c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:52.333967 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4d54b465-96e0-49b8-9cb3-232a3634cc5c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:52.341548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4d54b465-96e0-49b8-9cb3-232a3634cc5c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:52.342034 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4d54b465-96e0-49b8-9cb3-232a3634cc5c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:52.342458 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4d54b465-96e0-49b8-9cb3-232a3634cc5c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:52.343140 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4d54b465-96e0-49b8-9cb3-232a3634cc5c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:52.343584 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4d54b465-96e0-49b8-9cb3-232a3634cc5c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:52.344032 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4d54b465-96e0-49b8-9cb3-232a3634cc5c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:52.472156 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4d54b465-96e0-49b8-9cb3-232a3634cc5c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:52.480435 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4d54b465-96e0-49b8-9cb3-232a3634cc5c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 200 len: 1318 microversion: 2.1 time: 0.150952 Aug 29 20:40:52.481003 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 452/886] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:52 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:53.501522 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-91e96e45-ccee-434b-b0e7-74bbccd875c5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:53.502224 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-91e96e45-ccee-434b-b0e7-74bbccd875c5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:53.508525 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91e96e45-ccee-434b-b0e7-74bbccd875c5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:53.509022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91e96e45-ccee-434b-b0e7-74bbccd875c5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:53.509447 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91e96e45-ccee-434b-b0e7-74bbccd875c5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:53.510139 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91e96e45-ccee-434b-b0e7-74bbccd875c5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:53.510593 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91e96e45-ccee-434b-b0e7-74bbccd875c5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:53.511015 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-91e96e45-ccee-434b-b0e7-74bbccd875c5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:53.642547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-91e96e45-ccee-434b-b0e7-74bbccd875c5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:53.651433 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-91e96e45-ccee-434b-b0e7-74bbccd875c5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 200 len: 1318 microversion: 2.1 time: 0.153801 Aug 29 20:40:53.651433 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 435/887] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:53 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:54.671574 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-dcfd0b24-9f2a-4ec6-b902-ddabe1d45a06 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:54.672140 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-dcfd0b24-9f2a-4ec6-b902-ddabe1d45a06 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:54.678684 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-dcfd0b24-9f2a-4ec6-b902-ddabe1d45a06 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:54.679170 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-dcfd0b24-9f2a-4ec6-b902-ddabe1d45a06 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:54.679604 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-dcfd0b24-9f2a-4ec6-b902-ddabe1d45a06 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:54.680830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-dcfd0b24-9f2a-4ec6-b902-ddabe1d45a06 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:54.681285 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-dcfd0b24-9f2a-4ec6-b902-ddabe1d45a06 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:54.681947 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-dcfd0b24-9f2a-4ec6-b902-ddabe1d45a06 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:54.820239 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-dcfd0b24-9f2a-4ec6-b902-ddabe1d45a06 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:54.827959 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-dcfd0b24-9f2a-4ec6-b902-ddabe1d45a06 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 200 len: 1318 microversion: 2.1 time: 0.160364 Aug 29 20:40:54.828531 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 453/888] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:54 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:55.851267 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a2b2bec3-7e17-4dc7-810d-d6f7d4b8309c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:55.851878 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a2b2bec3-7e17-4dc7-810d-d6f7d4b8309c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:55.859764 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2b2bec3-7e17-4dc7-810d-d6f7d4b8309c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:55.860276 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2b2bec3-7e17-4dc7-810d-d6f7d4b8309c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:55.860705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2b2bec3-7e17-4dc7-810d-d6f7d4b8309c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:55.861396 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2b2bec3-7e17-4dc7-810d-d6f7d4b8309c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:55.861846 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2b2bec3-7e17-4dc7-810d-d6f7d4b8309c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:55.863470 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a2b2bec3-7e17-4dc7-810d-d6f7d4b8309c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:55.999062 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a2b2bec3-7e17-4dc7-810d-d6f7d4b8309c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:56.006777 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a2b2bec3-7e17-4dc7-810d-d6f7d4b8309c tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 200 len: 1318 microversion: 2.1 time: 0.160841 Aug 29 20:40:56.007529 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 436/889] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:55 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:57.029662 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4cf911c7-a6a0-492d-b5ad-dcb809317173 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:57.030282 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4cf911c7-a6a0-492d-b5ad-dcb809317173 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:57.036730 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4cf911c7-a6a0-492d-b5ad-dcb809317173 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:57.037211 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4cf911c7-a6a0-492d-b5ad-dcb809317173 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:57.037647 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4cf911c7-a6a0-492d-b5ad-dcb809317173 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:57.038342 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4cf911c7-a6a0-492d-b5ad-dcb809317173 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:57.038805 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4cf911c7-a6a0-492d-b5ad-dcb809317173 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:57.039232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4cf911c7-a6a0-492d-b5ad-dcb809317173 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:57.169838 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4cf911c7-a6a0-492d-b5ad-dcb809317173 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:57.177481 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4cf911c7-a6a0-492d-b5ad-dcb809317173 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 200 len: 1318 microversion: 2.1 time: 0.151750 Aug 29 20:40:57.178039 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 454/890] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:57 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:58.009977 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-b0cdaf35-3a9e-459c-8cff-e6191a7d7d3b req-f52e9d49-79fd-4144-a967-a8f2fa8cdd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f00e48-ce6f-46e3-9c3f-843ad53c1e17", "name": "network-vif-plugged", "status": "completed", "tag": "965dfd7e-6945-4afe-8e3c-f9f76a73a0ae"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:40:58.023422 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b0cdaf35-3a9e-459c-8cff-e6191a7d7d3b req-f52e9d49-79fd-4144-a967-a8f2fa8cdd77 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:58.024428 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b0cdaf35-3a9e-459c-8cff-e6191a7d7d3b req-f52e9d49-79fd-4144-a967-a8f2fa8cdd77 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:58.024932 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-b0cdaf35-3a9e-459c-8cff-e6191a7d7d3b req-f52e9d49-79fd-4144-a967-a8f2fa8cdd77 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:58.037332 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-b0cdaf35-3a9e-459c-8cff-e6191a7d7d3b req-f52e9d49-79fd-4144-a967-a8f2fa8cdd77 service nova] Creating event network-vif-plugged:965dfd7e-6945-4afe-8e3c-f9f76a73a0ae for instance 73f00e48-ce6f-46e3-9c3f-843ad53c1e17 on hv-cinder-85426 Aug 29 20:40:58.044706 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-b0cdaf35-3a9e-459c-8cff-e6191a7d7d3b req-f52e9d49-79fd-4144-a967-a8f2fa8cdd77 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037876 Aug 29 20:40:58.045844 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 437/891] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:40:58.198204 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-40af62d7-702c-4d65-8963-83395406190e tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:58.198824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-40af62d7-702c-4d65-8963-83395406190e tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:58.205231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-40af62d7-702c-4d65-8963-83395406190e tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:58.205716 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-40af62d7-702c-4d65-8963-83395406190e tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:58.206154 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-40af62d7-702c-4d65-8963-83395406190e tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:58.206850 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-40af62d7-702c-4d65-8963-83395406190e tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:58.207335 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-40af62d7-702c-4d65-8963-83395406190e tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:58.207762 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-40af62d7-702c-4d65-8963-83395406190e tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:58.358414 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-40af62d7-702c-4d65-8963-83395406190e tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:58.366171 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-40af62d7-702c-4d65-8963-83395406190e tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 200 len: 1318 microversion: 2.1 time: 0.171895 Aug 29 20:40:58.366814 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 455/892] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:58 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:40:59.383845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:59.384703 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:59.389514 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-703e2100-0065-40fe-9255-538318ba51d5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:40:59.390208 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-703e2100-0065-40fe-9255-538318ba51d5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:40:59.397148 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-703e2100-0065-40fe-9255-538318ba51d5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:59.397620 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-703e2100-0065-40fe-9255-538318ba51d5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:59.398046 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-703e2100-0065-40fe-9255-538318ba51d5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:59.398727 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-703e2100-0065-40fe-9255-538318ba51d5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:40:59.399171 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-703e2100-0065-40fe-9255-538318ba51d5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:40:59.399583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-703e2100-0065-40fe-9255-538318ba51d5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:40:59.528650 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-703e2100-0065-40fe-9255-538318ba51d5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:40:59.536357 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-703e2100-0065-40fe-9255-538318ba51d5 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 200 len: 1318 microversion: 2.1 time: 0.153368 Aug 29 20:40:59.536932 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 438/893] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:40:59 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:00.558044 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-17201cf4-3dff-4aac-8034-b0a53938e975 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:00.558654 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-17201cf4-3dff-4aac-8034-b0a53938e975 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:00.560557 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:00.566493 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-17201cf4-3dff-4aac-8034-b0a53938e975 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:00.567226 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-17201cf4-3dff-4aac-8034-b0a53938e975 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:00.567666 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-17201cf4-3dff-4aac-8034-b0a53938e975 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:00.568432 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-17201cf4-3dff-4aac-8034-b0a53938e975 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:00.568894 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-17201cf4-3dff-4aac-8034-b0a53938e975 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:00.569322 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-17201cf4-3dff-4aac-8034-b0a53938e975 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:00.719720 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-17201cf4-3dff-4aac-8034-b0a53938e975 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:00.728274 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-17201cf4-3dff-4aac-8034-b0a53938e975 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 200 len: 1506 microversion: 2.1 time: 0.173819 Aug 29 20:41:00.740744 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 456/894] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:00 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:01.547903 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-4c3afdf7-054f-41c4-a38a-725d394258dc req-fee8c305-6193-491d-8eff-dfa2a1c60f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36516f8-3de4-45fa-a124-83436dcfe1c1", "tag": "8ff3928a-585f-4fdd-9895-afd0c54f0e08"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:01.552547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c7bb8d35-7ae1-4896-8850-7496cd31f183 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:01.558787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c7bb8d35-7ae1-4896-8850-7496cd31f183 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:01.566228 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7bb8d35-7ae1-4896-8850-7496cd31f183 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:01.566790 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7bb8d35-7ae1-4896-8850-7496cd31f183 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:01.567304 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7bb8d35-7ae1-4896-8850-7496cd31f183 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:01.567511 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-4c3afdf7-054f-41c4-a38a-725d394258dc req-fee8c305-6193-491d-8eff-dfa2a1c60f54 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:01.568447 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7bb8d35-7ae1-4896-8850-7496cd31f183 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:01.569289 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7bb8d35-7ae1-4896-8850-7496cd31f183 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:01.569855 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c7bb8d35-7ae1-4896-8850-7496cd31f183 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:01.572278 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-4c3afdf7-054f-41c4-a38a-725d394258dc req-fee8c305-6193-491d-8eff-dfa2a1c60f54 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:01.572870 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-4c3afdf7-054f-41c4-a38a-725d394258dc req-fee8c305-6193-491d-8eff-dfa2a1c60f54 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:01.587674 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-4c3afdf7-054f-41c4-a38a-725d394258dc req-fee8c305-6193-491d-8eff-dfa2a1c60f54 service nova] Creating event network-changed:8ff3928a-585f-4fdd-9895-afd0c54f0e08 for instance f36516f8-3de4-45fa-a124-83436dcfe1c1 on hv-cinder-85426 Aug 29 20:41:01.593801 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-4c3afdf7-054f-41c4-a38a-725d394258dc req-fee8c305-6193-491d-8eff-dfa2a1c60f54 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049579 Aug 29 20:41:01.594893 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 457/895] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:41:01.602751 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c7bb8d35-7ae1-4896-8850-7496cd31f183 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:41:01.711012 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c7bb8d35-7ae1-4896-8850-7496cd31f183 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 204 len: 0 microversion: 2.1 time: 0.161811 Aug 29 20:41:01.712293 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 439/896] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:41:01 2022] DELETE /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:41:01.721960 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-c223e52f-7651-44fe-90dc-29249f71b69d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:01.722926 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-c223e52f-7651-44fe-90dc-29249f71b69d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:01.729678 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c223e52f-7651-44fe-90dc-29249f71b69d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:01.730421 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c223e52f-7651-44fe-90dc-29249f71b69d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:01.731032 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c223e52f-7651-44fe-90dc-29249f71b69d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:01.731914 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c223e52f-7651-44fe-90dc-29249f71b69d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:01.732563 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c223e52f-7651-44fe-90dc-29249f71b69d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:01.732985 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c223e52f-7651-44fe-90dc-29249f71b69d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:01.876610 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-c223e52f-7651-44fe-90dc-29249f71b69d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:01.885321 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c223e52f-7651-44fe-90dc-29249f71b69d tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.167568 Aug 29 20:41:01.885889 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 458/897] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:01 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:41:02.907585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f5fc48e1-191b-4a13-98c1-0ca2f289ffd8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:02.908314 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f5fc48e1-191b-4a13-98c1-0ca2f289ffd8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:02.915611 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5fc48e1-191b-4a13-98c1-0ca2f289ffd8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:02.916120 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5fc48e1-191b-4a13-98c1-0ca2f289ffd8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:02.916566 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5fc48e1-191b-4a13-98c1-0ca2f289ffd8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:02.917254 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5fc48e1-191b-4a13-98c1-0ca2f289ffd8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:02.917707 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5fc48e1-191b-4a13-98c1-0ca2f289ffd8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:02.918128 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f5fc48e1-191b-4a13-98c1-0ca2f289ffd8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:03.052340 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f5fc48e1-191b-4a13-98c1-0ca2f289ffd8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:03.060264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f5fc48e1-191b-4a13-98c1-0ca2f289ffd8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1566 microversion: 2.1 time: 0.156995 Aug 29 20:41:03.060831 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 440/898] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:02 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:04.083421 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-bcac3cf9-09e1-4650-a56d-bd084c0f62d0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:04.083992 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-bcac3cf9-09e1-4650-a56d-bd084c0f62d0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:04.091392 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bcac3cf9-09e1-4650-a56d-bd084c0f62d0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:04.092002 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bcac3cf9-09e1-4650-a56d-bd084c0f62d0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:04.092595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bcac3cf9-09e1-4650-a56d-bd084c0f62d0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:04.093603 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bcac3cf9-09e1-4650-a56d-bd084c0f62d0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:04.094136 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bcac3cf9-09e1-4650-a56d-bd084c0f62d0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:04.094833 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bcac3cf9-09e1-4650-a56d-bd084c0f62d0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:04.256231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-bcac3cf9-09e1-4650-a56d-bd084c0f62d0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:04.264307 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-bcac3cf9-09e1-4650-a56d-bd084c0f62d0 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1447 microversion: 2.1 time: 0.185219 Aug 29 20:41:04.264897 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 459/899] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:04 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:04.396404 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-aca9dd4b-163d-4601-8c9f-2e57f798d343 req-badfee02-325f-45e5-86cd-dd73a8dd043f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36516f8-3de4-45fa-a124-83436dcfe1c1", "name": "network-vif-deleted", "tag": "8ff3928a-585f-4fdd-9895-afd0c54f0e08"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:04.406707 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-aca9dd4b-163d-4601-8c9f-2e57f798d343 req-badfee02-325f-45e5-86cd-dd73a8dd043f service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:04.407196 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-aca9dd4b-163d-4601-8c9f-2e57f798d343 req-badfee02-325f-45e5-86cd-dd73a8dd043f service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:04.407614 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-aca9dd4b-163d-4601-8c9f-2e57f798d343 req-badfee02-325f-45e5-86cd-dd73a8dd043f service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:04.419125 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-aca9dd4b-163d-4601-8c9f-2e57f798d343 req-badfee02-325f-45e5-86cd-dd73a8dd043f service nova] Creating event network-vif-deleted:8ff3928a-585f-4fdd-9895-afd0c54f0e08 for instance f36516f8-3de4-45fa-a124-83436dcfe1c1 on hv-cinder-85426 Aug 29 20:41:04.423885 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-aca9dd4b-163d-4601-8c9f-2e57f798d343 req-badfee02-325f-45e5-86cd-dd73a8dd043f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031160 Aug 29 20:41:04.424538 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 441/900] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:41:05.286162 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7ce72f9b-37d7-41fc-a592-6ff3baa894be tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:05.286915 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7ce72f9b-37d7-41fc-a592-6ff3baa894be tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:05.294273 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ce72f9b-37d7-41fc-a592-6ff3baa894be tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:05.294765 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ce72f9b-37d7-41fc-a592-6ff3baa894be tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:05.295206 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ce72f9b-37d7-41fc-a592-6ff3baa894be tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:05.295914 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ce72f9b-37d7-41fc-a592-6ff3baa894be tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:05.296422 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ce72f9b-37d7-41fc-a592-6ff3baa894be tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:05.296870 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ce72f9b-37d7-41fc-a592-6ff3baa894be tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:05.330911 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ce72f9b-37d7-41fc-a592-6ff3baa894be tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:05.331402 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ce72f9b-37d7-41fc-a592-6ff3baa894be tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:05.331838 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7ce72f9b-37d7-41fc-a592-6ff3baa894be tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:05.332324 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-7ce72f9b-37d7-41fc-a592-6ff3baa894be tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lazy-loading 'fault' on Instance uuid f36516f8-3de4-45fa-a124-83436dcfe1c1 {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:41:05.377338 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7ce72f9b-37d7-41fc-a592-6ff3baa894be tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93ff419d60043f0aab0c11a6abdaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f93e5b4f52b4b8cac7e0336a44b33ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:05.385918 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7ce72f9b-37d7-41fc-a592-6ff3baa894be tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 200 len: 1223 microversion: 2.1 time: 0.103027 Aug 29 20:41:05.386518 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 460/901] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:05 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:06.408006 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ca1ae55-37f6-46c8-a4ef-ec8c9a33e7a8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:06.408697 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8ca1ae55-37f6-46c8-a4ef-ec8c9a33e7a8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] [instance: f36516f8-3de4-45fa-a124-83436dcfe1c1] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:06.414830 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ca1ae55-37f6-46c8-a4ef-ec8c9a33e7a8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:06.415297 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ca1ae55-37f6-46c8-a4ef-ec8c9a33e7a8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:06.415751 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ca1ae55-37f6-46c8-a4ef-ec8c9a33e7a8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:06.416447 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ca1ae55-37f6-46c8-a4ef-ec8c9a33e7a8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:06.416888 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ca1ae55-37f6-46c8-a4ef-ec8c9a33e7a8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:06.417301 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8ca1ae55-37f6-46c8-a4ef-ec8c9a33e7a8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:06.433689 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-8ca1ae55-37f6-46c8-a4ef-ec8c9a33e7a8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] HTTP exception thrown: Instance f36516f8-3de4-45fa-a124-83436dcfe1c1 could not be found. Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ca1ae55-37f6-46c8-a4ef-ec8c9a33e7a8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Request method failure captured: Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 HTTP/1.1 Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSL6hubBAxHm3svShFU3nlNgXRPMcGk2rv8UoIL48XGzT4Y3j6_4hsUt5sgghjf0YrZijP5QAiCK6I6eLToTk2i17nu9yp-KycSJ_LPdktoM5dpVg6VaCX6r8rELMLxrEvz3RQY6Qy60fVc6sTP5v5rMckTTRDuUzjR___MGdxqQAp4 Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 2f93e5b4f52b4b8cac7e0336a44b33ba Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-TestShelveInstance-329623231 Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:41:06.435353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:41:06.437371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2f93e5b4f52b4b8cac7e0336a44b33ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f93e5b4f52b4b8cac7e0336a44b33ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f93e5b4f52b4b8cac7e0336a44b33ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2f93e5b4f52b4b8cac7e0336a44b33ba"}]}] Aug 29 20:41:06.437371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-TestShelveInstance-329623231 Aug 29 20:41:06.437371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 2f93e5b4f52b4b8cac7e0336a44b33ba Aug 29 20:41:06.437371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-TestShelveInstance-329623231 Aug 29 20:41:06.437371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-TestShelveInstance-329623231-project Aug 29 20:41:06.437371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:41:06.437371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:41:06.437371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: b93ff419d60043f0aab0c11a6abdaa38 Aug 29 20:41:06.437371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-TestShelveInstance-329623231-project Aug 29 20:41:06.437371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:41:06.437371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance f36516f8-3de4-45fa-a124-83436dcfe1c1 could not be found. Aug 29 20:41:06.437371 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': 'f36516f8-3de4-45fa-a124-83436dcfe1c1'} Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36516f8-3de4-45fa-a124-83436dcfe1c1 could not be found. Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:41:06.438547 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36516f8-3de4-45fa-a124-83436dcfe1c1 could not be found. Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36516f8-3de4-45fa-a124-83436dcfe1c1 could not be found. Aug 29 20:41:06.441115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:06.443532 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8ca1ae55-37f6-46c8-a4ef-ec8c9a33e7a8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Returning 404 to user: Instance f36516f8-3de4-45fa-a124-83436dcfe1c1 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:41:06.443532 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8ca1ae55-37f6-46c8-a4ef-ec8c9a33e7a8 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1" status: 404 len: 111 microversion: 2.1 time: 0.033504 Aug 29 20:41:06.443532 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 442/902] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:06 2022] GET /compute/v2.1/servers/f36516f8-3de4-45fa-a124-83436dcfe1c1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:41:06.612898 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-eca8185f-1a6f-458c-ba5c-30c92d9d0fe6 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] Calling method '.version_select at 0x7f48632788b0>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:06.638243 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-eca8185f-1a6f-458c-ba5c-30c92d9d0fe6 tempest-TestShelveInstance-329623231 tempest-TestShelveInstance-329623231-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-959246705" status: 202 len: 0 microversion: 2.1 time: 0.029243 Aug 29 20:41:06.638856 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 461/903] 10.222.0.18 () {58 vars in 1251 bytes} [Mon Aug 29 20:41:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-959246705 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:41:18.122955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1dc73db9-ff85-4341-8a41-bf50e9307302 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a4c4321-9dcb-4cb7-ad11-8cd497a99e2a", "device": "/dev/sdb"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:18.125756 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1dc73db9-ff85-4341-8a41-bf50e9307302 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:18.128577 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:18.129269 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:18.135353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dc73db9-ff85-4341-8a41-bf50e9307302 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:18.135828 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dc73db9-ff85-4341-8a41-bf50e9307302 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:18.136286 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dc73db9-ff85-4341-8a41-bf50e9307302 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:18.136978 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dc73db9-ff85-4341-8a41-bf50e9307302 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:18.137426 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dc73db9-ff85-4341-8a41-bf50e9307302 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:18.137840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1dc73db9-ff85-4341-8a41-bf50e9307302 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:18.389497 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1dc73db9-ff85-4341-8a41-bf50e9307302 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "POST /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271159 Aug 29 20:41:18.390125 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 443/904] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 29 20:41:18 2022] POST /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:41:19.706273 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d443be60-1b68-45d0-8428-f1c6b6a48758 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:19.708511 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d443be60-1b68-45d0-8428-f1c6b6a48758 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:19.711205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=58 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:19.712444 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:19.718793 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d443be60-1b68-45d0-8428-f1c6b6a48758 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:19.719274 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d443be60-1b68-45d0-8428-f1c6b6a48758 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:19.719709 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d443be60-1b68-45d0-8428-f1c6b6a48758 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:19.720431 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d443be60-1b68-45d0-8428-f1c6b6a48758 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:19.720880 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d443be60-1b68-45d0-8428-f1c6b6a48758 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:19.721298 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d443be60-1b68-45d0-8428-f1c6b6a48758 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:19.750734 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d443be60-1b68-45d0-8428-f1c6b6a48758 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048526 Aug 29 20:41:19.751287 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 462/905] 10.222.0.18 () {60 vars in 1343 bytes} [Mon Aug 29 20:41:19 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:19.812842 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf0ff1fa-6916-45db-b4e9-d3625d3e0667 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:19.813418 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf0ff1fa-6916-45db-b4e9-d3625d3e0667 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:19.819573 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf0ff1fa-6916-45db-b4e9-d3625d3e0667 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:19.820093 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf0ff1fa-6916-45db-b4e9-d3625d3e0667 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:19.820524 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf0ff1fa-6916-45db-b4e9-d3625d3e0667 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:19.821699 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf0ff1fa-6916-45db-b4e9-d3625d3e0667 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:19.822149 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf0ff1fa-6916-45db-b4e9-d3625d3e0667 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:19.822568 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf0ff1fa-6916-45db-b4e9-d3625d3e0667 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:19.848456 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf0ff1fa-6916-45db-b4e9-d3625d3e0667 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:41:19.925770 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf0ff1fa-6916-45db-b4e9-d3625d3e0667 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 204 len: 0 microversion: 2.20 time: 0.117548 Aug 29 20:41:19.926719 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 444/906] 10.222.0.18 () {60 vars in 1280 bytes} [Mon Aug 29 20:41:19 2022] DELETE /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 20:41:19.936782 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-bab89312-48c9-4635-a10a-5237e5d9d736 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:19.937891 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-bab89312-48c9-4635-a10a-5237e5d9d736 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:19.944718 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bab89312-48c9-4635-a10a-5237e5d9d736 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:19.944873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bab89312-48c9-4635-a10a-5237e5d9d736 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:19.945279 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bab89312-48c9-4635-a10a-5237e5d9d736 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:19.946769 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bab89312-48c9-4635-a10a-5237e5d9d736 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:19.947229 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bab89312-48c9-4635-a10a-5237e5d9d736 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:19.947845 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-bab89312-48c9-4635-a10a-5237e5d9d736 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:20.086980 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-bab89312-48c9-4635-a10a-5237e5d9d736 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:20.095028 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-bab89312-48c9-4635-a10a-5237e5d9d736 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:20.096483 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-bab89312-48c9-4635-a10a-5237e5d9d736 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:20.097640 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-bab89312-48c9-4635-a10a-5237e5d9d736 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1724 microversion: 2.20 time: 0.165450 Aug 29 20:41:20.098193 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 463/907] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:41:19 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:41:21.123153 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5ad220ef-d3ec-4e03-af39-9874094e37ef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:21.123858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5ad220ef-d3ec-4e03-af39-9874094e37ef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:21.130223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ad220ef-d3ec-4e03-af39-9874094e37ef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:21.130698 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ad220ef-d3ec-4e03-af39-9874094e37ef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:21.131129 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ad220ef-d3ec-4e03-af39-9874094e37ef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:21.131819 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ad220ef-d3ec-4e03-af39-9874094e37ef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:21.132305 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ad220ef-d3ec-4e03-af39-9874094e37ef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:21.132731 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5ad220ef-d3ec-4e03-af39-9874094e37ef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:21.264710 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5ad220ef-d3ec-4e03-af39-9874094e37ef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:21.272975 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5ad220ef-d3ec-4e03-af39-9874094e37ef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:21.275003 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5ad220ef-d3ec-4e03-af39-9874094e37ef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:21.276195 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5ad220ef-d3ec-4e03-af39-9874094e37ef tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1724 microversion: 2.20 time: 0.158664 Aug 29 20:41:21.276754 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 445/908] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:41:21 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:41:22.298825 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-5770e5cf-5943-46bf-a803-67c554abd294 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:22.299442 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-5770e5cf-5943-46bf-a803-67c554abd294 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:22.306528 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5770e5cf-5943-46bf-a803-67c554abd294 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:22.307605 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5770e5cf-5943-46bf-a803-67c554abd294 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:22.307605 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5770e5cf-5943-46bf-a803-67c554abd294 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:22.308310 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5770e5cf-5943-46bf-a803-67c554abd294 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:22.308768 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5770e5cf-5943-46bf-a803-67c554abd294 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:22.309203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5770e5cf-5943-46bf-a803-67c554abd294 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:22.380233 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-5770e5cf-5943-46bf-a803-67c554abd294 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:22.388695 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-5770e5cf-5943-46bf-a803-67c554abd294 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:22.390139 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-5770e5cf-5943-46bf-a803-67c554abd294 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '068f28eb74e74650a2b80d29664109ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf00868e84384ee59320184a5e1c46c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:22.391321 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-5770e5cf-5943-46bf-a803-67c554abd294 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 200 len: 1656 microversion: 2.20 time: 0.096551 Aug 29 20:41:22.392151 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 464/909] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:41:22 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 1656 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 20:41:22.616026 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f26e1f12-680c-4a64-b245-427fa680dd58 req-9edb4a48-cb34-4d7f-94f0-1c2e0e3324cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8c3779-360e-43b6-8c43-50a3008159ea", "name": "network-vif-deleted", "tag": "13477485-5060-4306-b273-b24627558f04"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:22.627114 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f26e1f12-680c-4a64-b245-427fa680dd58 req-9edb4a48-cb34-4d7f-94f0-1c2e0e3324cc service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:22.627618 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f26e1f12-680c-4a64-b245-427fa680dd58 req-9edb4a48-cb34-4d7f-94f0-1c2e0e3324cc service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:22.628092 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f26e1f12-680c-4a64-b245-427fa680dd58 req-9edb4a48-cb34-4d7f-94f0-1c2e0e3324cc service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:22.642709 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f26e1f12-680c-4a64-b245-427fa680dd58 req-9edb4a48-cb34-4d7f-94f0-1c2e0e3324cc service nova] Creating event network-vif-deleted:13477485-5060-4306-b273-b24627558f04 for instance bb8c3779-360e-43b6-8c43-50a3008159ea on hv-cinder-85426 Aug 29 20:41:22.648948 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f26e1f12-680c-4a64-b245-427fa680dd58 req-9edb4a48-cb34-4d7f-94f0-1c2e0e3324cc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036557 Aug 29 20:41:22.651061 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 446/910] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:41:23.415413 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8c213fff-7bd0-45a4-8e75-240438f90c28 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:23.416043 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8c213fff-7bd0-45a4-8e75-240438f90c28 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:23.422631 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c213fff-7bd0-45a4-8e75-240438f90c28 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:23.423404 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c213fff-7bd0-45a4-8e75-240438f90c28 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:23.423532 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c213fff-7bd0-45a4-8e75-240438f90c28 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:23.424254 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c213fff-7bd0-45a4-8e75-240438f90c28 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:23.424701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c213fff-7bd0-45a4-8e75-240438f90c28 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:23.425121 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8c213fff-7bd0-45a4-8e75-240438f90c28 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:23.442258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-8c213fff-7bd0-45a4-8e75-240438f90c28 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] HTTP exception thrown: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8c213fff-7bd0-45a4-8e75-240438f90c28 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Request method failure captured: Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea HTTP/1.1 Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSLllIGoYQVNJ19RkWKiIV7OLjtXRlQVmLOiuOjViYoOomBXMhB5rE-xIWnJg3Sl5boihtrMXQlk4M0OlxkHCnMMUBY2U-9TZ_pZ3V5AewnxytY6zCxGTuOh8hnKErSUKOdyTov-kf5-wdGl_ZzF92MY5rtcVHrYr3XA7-aZfcpLRz8 Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: bf00868e84384ee59320184a5e1c46c8 Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:41:23.443905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:41:23.445642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bf00868e84384ee59320184a5e1c46c8"}]}] Aug 29 20:41:23.445642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:23.445642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: bf00868e84384ee59320184a5e1c46c8 Aug 29 20:41:23.445642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:23.445642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeShelveTestJSON-889412031-project Aug 29 20:41:23.445642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:41:23.445642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:41:23.445642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 068f28eb74e74650a2b80d29664109ae Aug 29 20:41:23.445642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeShelveTestJSON-889412031-project Aug 29 20:41:23.445642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:41:23.445642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:23.445642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': 'bb8c3779-360e-43b6-8c43-50a3008159ea'} Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:41:23.446575 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:23.448097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:23.450083 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8c213fff-7bd0-45a4-8e75-240438f90c28 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Returning 404 to user: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:41:23.450083 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8c213fff-7bd0-45a4-8e75-240438f90c28 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 404 len: 111 microversion: 2.20 time: 0.034432 Aug 29 20:41:23.450083 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 465/911] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:41:23 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:41:23.455338 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fb2ae482-aa48-481a-8212-40ada2b817b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '.version_select at 0x7f4863255ee0>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:23.459884 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fb2ae482-aa48-481a-8212-40ada2b817b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [71d89fa8-fa41-47f7-8c6a-f9fbe0e7c8b9] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 20:41:24.467614 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [None req-fb2ae482-aa48-481a-8212-40ada2b817b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [71d89fa8-fa41-47f7-8c6a-f9fbe0e7c8b9] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 42912. Aug 29 20:41:24.487199 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fb2ae482-aa48-481a-8212-40ada2b817b9 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039002236" status: 204 len: 0 microversion: 2.20 time: 1.036386 Aug 29 20:41:24.487771 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 447/912] 10.222.0.18 () {60 vars in 1262 bytes} [Mon Aug 29 20:41:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039002236 => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 20:41:26.281150 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-0e0f5f84-6573-42af-9cca-4edf423b495e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:26.281644 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-0e0f5f84-6573-42af-9cca-4edf423b495e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:26.287613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0e0f5f84-6573-42af-9cca-4edf423b495e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:26.288128 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0e0f5f84-6573-42af-9cca-4edf423b495e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:26.288559 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0e0f5f84-6573-42af-9cca-4edf423b495e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:26.289249 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0e0f5f84-6573-42af-9cca-4edf423b495e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:26.289694 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0e0f5f84-6573-42af-9cca-4edf423b495e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:26.290689 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-0e0f5f84-6573-42af-9cca-4edf423b495e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:26.304487 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-0e0f5f84-6573-42af-9cca-4edf423b495e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] HTTP exception thrown: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-0e0f5f84-6573-42af-9cca-4edf423b495e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Request method failure captured: Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: DELETE /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea HTTP/1.1 Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSLllIGoYQVNJ19RkWKiIV7OLjtXRlQVmLOiuOjViYoOomBXMhB5rE-xIWnJg3Sl5boihtrMXQlk4M0OlxkHCnMMUBY2U-9TZ_pZ3V5AewnxytY6zCxGTuOh8hnKErSUKOdyTov-kf5-wdGl_ZzF92MY5rtcVHrYr3XA7-aZfcpLRz8 Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: bf00868e84384ee59320184a5e1c46c8 Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:41:26.306758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:41:26.308667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bf00868e84384ee59320184a5e1c46c8"}]}] Aug 29 20:41:26.308667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:26.308667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: bf00868e84384ee59320184a5e1c46c8 Aug 29 20:41:26.308667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:26.308667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeShelveTestJSON-889412031-project Aug 29 20:41:26.308667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:41:26.308667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:41:26.308667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 068f28eb74e74650a2b80d29664109ae Aug 29 20:41:26.308667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeShelveTestJSON-889412031-project Aug 29 20:41:26.308667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:41:26.308667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:26.308667 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': 'bb8c3779-360e-43b6-8c43-50a3008159ea'} Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:41:26.310303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:26.311830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:26.313789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-0e0f5f84-6573-42af-9cca-4edf423b495e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Returning 404 to user: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:41:26.313789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-0e0f5f84-6573-42af-9cca-4edf423b495e tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 404 len: 111 microversion: 2.20 time: 0.031109 Aug 29 20:41:26.313789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 466/913] 10.222.0.18 () {60 vars in 1280 bytes} [Mon Aug 29 20:41:26 2022] DELETE /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:41:26.317698 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c133a8eb-e6f2-44ee-b81e-b5c19b7cf4d8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:26.318427 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-c133a8eb-e6f2-44ee-b81e-b5c19b7cf4d8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: bb8c3779-360e-43b6-8c43-50a3008159ea] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:26.324728 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c133a8eb-e6f2-44ee-b81e-b5c19b7cf4d8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:26.325202 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c133a8eb-e6f2-44ee-b81e-b5c19b7cf4d8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:26.325628 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c133a8eb-e6f2-44ee-b81e-b5c19b7cf4d8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:26.326319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c133a8eb-e6f2-44ee-b81e-b5c19b7cf4d8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:26.326801 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c133a8eb-e6f2-44ee-b81e-b5c19b7cf4d8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:26.327222 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-c133a8eb-e6f2-44ee-b81e-b5c19b7cf4d8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:26.340664 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-c133a8eb-e6f2-44ee-b81e-b5c19b7cf4d8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] HTTP exception thrown: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c133a8eb-e6f2-44ee-b81e-b5c19b7cf4d8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Request method failure captured: Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea HTTP/1.1 Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSLllIGoYQVNJ19RkWKiIV7OLjtXRlQVmLOiuOjViYoOomBXMhB5rE-xIWnJg3Sl5boihtrMXQlk4M0OlxkHCnMMUBY2U-9TZ_pZ3V5AewnxytY6zCxGTuOh8hnKErSUKOdyTov-kf5-wdGl_ZzF92MY5rtcVHrYr3XA7-aZfcpLRz8 Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: bf00868e84384ee59320184a5e1c46c8 Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:41:26.342355 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:41:26.344227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bf00868e84384ee59320184a5e1c46c8"}]}] Aug 29 20:41:26.344227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:26.344227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: bf00868e84384ee59320184a5e1c46c8 Aug 29 20:41:26.344227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:26.344227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-AttachVolumeShelveTestJSON-889412031-project Aug 29 20:41:26.344227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:41:26.344227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:41:26.344227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 068f28eb74e74650a2b80d29664109ae Aug 29 20:41:26.344227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeShelveTestJSON-889412031-project Aug 29 20:41:26.344227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:41:26.344227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:26.344227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': 'bb8c3779-360e-43b6-8c43-50a3008159ea'} Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:41:26.345295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. Aug 29 20:41:26.346778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:26.348155 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-c133a8eb-e6f2-44ee-b81e-b5c19b7cf4d8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Returning 404 to user: Instance bb8c3779-360e-43b6-8c43-50a3008159ea could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:41:26.348155 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-c133a8eb-e6f2-44ee-b81e-b5c19b7cf4d8 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea" status: 404 len: 111 microversion: 2.20 time: 0.030448 Aug 29 20:41:26.348155 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 448/914] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:41:26 2022] GET /compute/v2.1/servers/bb8c3779-360e-43b6-8c43-50a3008159ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:41:30.681910 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d6c8ce0d-3dfe-4b7d-9a86-d14a73437f78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:30.682427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d6c8ce0d-3dfe-4b7d-9a86-d14a73437f78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:30.684384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 20:41:30.684525 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Mon Aug 29 20:41:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 (ip 10.222.0.18) !!! Aug 29 20:41:30.690860 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6c8ce0d-3dfe-4b7d-9a86-d14a73437f78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:30.691336 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6c8ce0d-3dfe-4b7d-9a86-d14a73437f78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:30.691765 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6c8ce0d-3dfe-4b7d-9a86-d14a73437f78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:30.692482 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6c8ce0d-3dfe-4b7d-9a86-d14a73437f78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:30.692928 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6c8ce0d-3dfe-4b7d-9a86-d14a73437f78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:30.693348 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d6c8ce0d-3dfe-4b7d-9a86-d14a73437f78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:30.708237 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-d6c8ce0d-3dfe-4b7d-9a86-d14a73437f78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] HTTP exception thrown: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d6c8ce0d-3dfe-4b7d-9a86-d14a73437f78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Request method failure captured: Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: DELETE /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 HTTP/1.1 Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSLllIGoYQVNJ19RkWKiIV7OLjtXRlQVmLOiuOjViYoOomBXMhB5rE-xIWnJg3Sl5boihtrMXQlk4M0OlxkHCnMMUBY2U-9TZ_pZ3V5AewnxytY6zCxGTuOh8hnKErSUKOdyTov-kf5-wdGl_ZzF92MY5rtcVHrYr3XA7-aZfcpLRz8 Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: bf00868e84384ee59320184a5e1c46c8 Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:41:30.709784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:41:30.711578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bf00868e84384ee59320184a5e1c46c8"}]}] Aug 29 20:41:30.711578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:30.711578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: bf00868e84384ee59320184a5e1c46c8 Aug 29 20:41:30.711578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:30.711578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeShelveTestJSON-889412031-project Aug 29 20:41:30.711578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:41:30.711578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:41:30.711578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 068f28eb74e74650a2b80d29664109ae Aug 29 20:41:30.711578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeShelveTestJSON-889412031-project Aug 29 20:41:30.711578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:41:30.711578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:41:30.711578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '95026449-87b2-4f37-bfd3-554df7e6a037'} Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:41:30.712463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:41:30.714026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:41:30.715346 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d6c8ce0d-3dfe-4b7d-9a86-d14a73437f78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Returning 404 to user: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:41:30.715346 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d6c8ce0d-3dfe-4b7d-9a86-d14a73437f78 tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 404 len: 111 microversion: 2.20 time: 0.033671 Aug 29 20:41:30.715346 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 467/915] 10.222.0.18 () {60 vars in 1280 bytes} [Mon Aug 29 20:41:30 2022] DELETE /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:41:30.719765 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae6a091a-d56a-4454-9b5b-ee1c4d34cf7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:30.720400 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ae6a091a-d56a-4454-9b5b-ee1c4d34cf7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] [instance: 95026449-87b2-4f37-bfd3-554df7e6a037] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:30.727200 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae6a091a-d56a-4454-9b5b-ee1c4d34cf7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:30.728187 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae6a091a-d56a-4454-9b5b-ee1c4d34cf7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:30.728650 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae6a091a-d56a-4454-9b5b-ee1c4d34cf7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:30.729325 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae6a091a-d56a-4454-9b5b-ee1c4d34cf7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:30.729767 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae6a091a-d56a-4454-9b5b-ee1c4d34cf7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:30.730177 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ae6a091a-d56a-4454-9b5b-ee1c4d34cf7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:30.744082 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-ae6a091a-d56a-4454-9b5b-ee1c4d34cf7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] HTTP exception thrown: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae6a091a-d56a-4454-9b5b-ee1c4d34cf7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Request method failure captured: Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 HTTP/1.1 Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSLllIGoYQVNJ19RkWKiIV7OLjtXRlQVmLOiuOjViYoOomBXMhB5rE-xIWnJg3Sl5boihtrMXQlk4M0OlxkHCnMMUBY2U-9TZ_pZ3V5AewnxytY6zCxGTuOh8hnKErSUKOdyTov-kf5-wdGl_ZzF92MY5rtcVHrYr3XA7-aZfcpLRz8 Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: bf00868e84384ee59320184a5e1c46c8 Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:41:30.745535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:41:30.747351 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf00868e84384ee59320184a5e1c46c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bf00868e84384ee59320184a5e1c46c8"}]}] Aug 29 20:41:30.747351 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:30.747351 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: bf00868e84384ee59320184a5e1c46c8 Aug 29 20:41:30.747351 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-889412031 Aug 29 20:41:30.747351 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-AttachVolumeShelveTestJSON-889412031-project Aug 29 20:41:30.747351 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:41:30.747351 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:41:30.747351 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 068f28eb74e74650a2b80d29664109ae Aug 29 20:41:30.747351 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeShelveTestJSON-889412031-project Aug 29 20:41:30.747351 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:41:30.747351 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:41:30.747351 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '95026449-87b2-4f37-bfd3-554df7e6a037'} Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:41:30.748320 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. Aug 29 20:41:30.749840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:30.751309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ae6a091a-d56a-4454-9b5b-ee1c4d34cf7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] Returning 404 to user: Instance 95026449-87b2-4f37-bfd3-554df7e6a037 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:41:30.751309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ae6a091a-d56a-4454-9b5b-ee1c4d34cf7d tempest-AttachVolumeShelveTestJSON-889412031 tempest-AttachVolumeShelveTestJSON-889412031-project] 10.222.0.18 "GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037" status: 404 len: 111 microversion: 2.20 time: 0.030912 Aug 29 20:41:30.751309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 449/916] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Aug 29 20:41:30 2022] GET /compute/v2.1/servers/95026449-87b2-4f37-bfd3-554df7e6a037 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 20:41:40.262703 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8e2ef1b2-15dc-4b4a-81e1-be0d1ca5767e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Action: 'create', calling method: .version_select at 0x7f4863278ee0>, body: {"keypair": {"name": "tempest-keypair-1641027586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYJTrnqk2f4dzUzU6wNASXW6qOLhrn3/YzCY5aj8YfqZD6Q0T6yvi/GcvPRQFoIiXmvn4h/gDcjunIMP6GWiA2Q8v4TTqz3KbwSHqi7QsFC0HPiyiWq+FSYtxFGxnNnPg=="}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:40.284475 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-8e2ef1b2-15dc-4b4a-81e1-be0d1ca5767e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for project 076e4d9f49a944c487077e845726ad82. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:41:40.289049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-8e2ef1b2-15dc-4b4a-81e1-be0d1ca5767e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for user 70aaca5187e54f25ad94d9515278e039 and project 076e4d9f49a944c487077e845726ad82. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:41:40.316165 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8e2ef1b2-15dc-4b4a-81e1-be0d1ca5767e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.240671 Aug 29 20:41:40.317149 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 468/917] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 29 20:41:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:41:41.801289 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1200609176", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "931f5e99-b53b-4e33-bc47-b08971122f04"}], "security_groups": [{"name": "tempest-securitygroup--1037687742"}], "key_name": "tempest-keypair-1641027586", "user_data": "}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:41.811262 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:41.812403 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:41.935585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] validate_networks() for [('931f5e99-b53b-4e33-bc47-b08971122f04', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:41:42.378123 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:41:42.378552 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:41:42.379242 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:41:42.379667 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:41:42.380102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:41:42.389695 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:42.390217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:42.390619 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:42.391535 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:42.392237 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:42.392674 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:42.413207 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for project 076e4d9f49a944c487077e845726ad82. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:41:42.418650 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for user 70aaca5187e54f25ad94d9515278e039 and project 076e4d9f49a944c487077e845726ad82. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:41:42.432826 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:41:42.435412 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:41:42.489089 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4ab83439-2363-4feb-801a-3489f290667a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.691942 Aug 29 20:41:42.490102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 450/918] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:41:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:41:42.498276 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=24 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:42.504692 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e6be0a89-e571-4e8a-927c-52a35ba58494 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:42.505576 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e6be0a89-e571-4e8a-927c-52a35ba58494 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:42.567899 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e6be0a89-e571-4e8a-927c-52a35ba58494 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:42.576923 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e6be0a89-e571-4e8a-927c-52a35ba58494 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1242 microversion: 2.1 time: 0.079875 Aug 29 20:41:42.577416 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 469/919] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:42 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:43.129559 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1023466842", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1635581417", "security_groups": [{"name": "tempest-secgroup-smoke-403245879"}], "block_device_mapping_v2": [{"uuid": "030a4df6-70b8-450b-8373-6135aa38e67c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6506ef9d-c593-4e22-ac07-3e14f3411bf3"}]}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:43.362434 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] validate_networks() for [('6506ef9d-c593-4e22-ac07-3e14f3411bf3', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:41:43.600945 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-395d1063-b1d0-45bd-ab86-41a8629c87d7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:43.602875 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-395d1063-b1d0-45bd-ab86-41a8629c87d7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:43.617560 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-395d1063-b1d0-45bd-ab86-41a8629c87d7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:43.618675 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-395d1063-b1d0-45bd-ab86-41a8629c87d7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:43.620733 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-395d1063-b1d0-45bd-ab86-41a8629c87d7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:43.622032 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-395d1063-b1d0-45bd-ab86-41a8629c87d7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:43.622746 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-395d1063-b1d0-45bd-ab86-41a8629c87d7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:43.623507 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-395d1063-b1d0-45bd-ab86-41a8629c87d7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:43.716969 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-395d1063-b1d0-45bd-ab86-41a8629c87d7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:43.726193 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-395d1063-b1d0-45bd-ab86-41a8629c87d7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1294 microversion: 2.1 time: 0.130467 Aug 29 20:41:43.727225 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 470/920] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:43 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1294 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:43.866635 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:41:43.867256 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:41:43.867725 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:41:43.868198 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:41:43.868605 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:41:43.879860 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:43.881265 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:43.882388 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:43.883834 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:43.884686 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:43.885799 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:43.928717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Getting quotas for project 4ac573b4aa7a47c49d129afd9939e26d. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:41:43.934981 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Getting quotas for user fca06f41184444ccb0ddb57e5d44f227 and project 4ac573b4aa7a47c49d129afd9939e26d. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:41:44.037364 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:41:44.039966 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='030a4df6-70b8-450b-8373-6135aa38e67c',volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:41:44.187408 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-673885c8-9d9c-4914-a921-7e5fa52577b6 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.061901 Aug 29 20:41:44.188638 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 451/921] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:41:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:41:44.199678 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-3d00d862-ed97-49c8-a1b2-ddc4875ba134 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:44.200324 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-3d00d862-ed97-49c8-a1b2-ddc4875ba134 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:44.280546 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-3d00d862-ed97-49c8-a1b2-ddc4875ba134 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:44.292240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-3d00d862-ed97-49c8-a1b2-ddc4875ba134 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1095 microversion: 2.1 time: 0.095196 Aug 29 20:41:44.292240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 471/922] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:44 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1095 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:44.750421 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-37eaf7e9-c9df-497b-9e47-f85491bdd3ac tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:44.751885 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-37eaf7e9-c9df-497b-9e47-f85491bdd3ac tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:44.758265 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37eaf7e9-c9df-497b-9e47-f85491bdd3ac tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:44.759479 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37eaf7e9-c9df-497b-9e47-f85491bdd3ac tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:44.759950 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37eaf7e9-c9df-497b-9e47-f85491bdd3ac tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:44.760702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37eaf7e9-c9df-497b-9e47-f85491bdd3ac tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:44.761149 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37eaf7e9-c9df-497b-9e47-f85491bdd3ac tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:44.761635 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37eaf7e9-c9df-497b-9e47-f85491bdd3ac tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:44.994015 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-37eaf7e9-c9df-497b-9e47-f85491bdd3ac tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:45.004487 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-37eaf7e9-c9df-497b-9e47-f85491bdd3ac tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1368 microversion: 2.1 time: 0.258070 Aug 29 20:41:45.005578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 452/923] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:44 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:45.320236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4b99f25f-9ca7-436a-b8bb-89c82aabfa38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:45.321741 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4b99f25f-9ca7-436a-b8bb-89c82aabfa38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:45.331024 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b99f25f-9ca7-436a-b8bb-89c82aabfa38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:45.332509 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b99f25f-9ca7-436a-b8bb-89c82aabfa38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:45.333150 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b99f25f-9ca7-436a-b8bb-89c82aabfa38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:45.334064 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b99f25f-9ca7-436a-b8bb-89c82aabfa38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:45.334844 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b99f25f-9ca7-436a-b8bb-89c82aabfa38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:45.335376 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b99f25f-9ca7-436a-b8bb-89c82aabfa38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:45.404109 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4b99f25f-9ca7-436a-b8bb-89c82aabfa38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:45.412060 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4b99f25f-9ca7-436a-b8bb-89c82aabfa38 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1193 microversion: 2.1 time: 0.096702 Aug 29 20:41:45.416746 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 472/924] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:45 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1193 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:45.471643 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d02be9e4-65af-483d-82f5-8017a3743ee9 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:45.472865 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d02be9e4-65af-483d-82f5-8017a3743ee9 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:45.480976 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d02be9e4-65af-483d-82f5-8017a3743ee9 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:45.481836 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d02be9e4-65af-483d-82f5-8017a3743ee9 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:45.482512 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d02be9e4-65af-483d-82f5-8017a3743ee9 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:45.483465 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d02be9e4-65af-483d-82f5-8017a3743ee9 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:45.484170 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d02be9e4-65af-483d-82f5-8017a3743ee9 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:45.484817 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d02be9e4-65af-483d-82f5-8017a3743ee9 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:45.562665 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-9c8759ed-3974-4767-84ab-ddf1dcdb5a63 req-01945da3-5a15-4dbb-9b09-655c9e2451a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ea03034-17ef-42a5-af06-60d8e43be248", "tag": "7dac8a78-45b2-4c8a-a9c8-11b8dddbb08a"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:45.597322 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-9c8759ed-3974-4767-84ab-ddf1dcdb5a63 req-01945da3-5a15-4dbb-9b09-655c9e2451a6 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:45.597905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-9c8759ed-3974-4767-84ab-ddf1dcdb5a63 req-01945da3-5a15-4dbb-9b09-655c9e2451a6 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:45.599426 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-9c8759ed-3974-4767-84ab-ddf1dcdb5a63 req-01945da3-5a15-4dbb-9b09-655c9e2451a6 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:45.606835 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-d02be9e4-65af-483d-82f5-8017a3743ee9 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lazy-loading 'services' on Instance uuid 73f00e48-ce6f-46e3-9c3f-843ad53c1e17 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:41:45.631121 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-9c8759ed-3974-4767-84ab-ddf1dcdb5a63 req-01945da3-5a15-4dbb-9b09-655c9e2451a6 service nova] Creating event network-changed:7dac8a78-45b2-4c8a-a9c8-11b8dddbb08a for instance 2ea03034-17ef-42a5-af06-60d8e43be248 on hv-cinder-85426 Aug 29 20:41:45.643143 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-9c8759ed-3974-4767-84ab-ddf1dcdb5a63 req-01945da3-5a15-4dbb-9b09-655c9e2451a6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080064 Aug 29 20:41:45.644126 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 473/925] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:41:45.744616 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d02be9e4-65af-483d-82f5-8017a3743ee9 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "DELETE /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17/os-volume_attachments/3a4c4321-9dcb-4cb7-ad11-8cd497a99e2a" status: 202 len: 0 microversion: 2.1 time: 0.276697 Aug 29 20:41:45.746113 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 453/926] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 29 20:41:45 2022] DELETE /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17/os-volume_attachments/3a4c4321-9dcb-4cb7-ad11-8cd497a99e2a => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:41:46.026745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8b504237-d32d-4f0f-a2a6-87c627823c8c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:46.027455 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8b504237-d32d-4f0f-a2a6-87c627823c8c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:46.033738 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8b504237-d32d-4f0f-a2a6-87c627823c8c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:46.034562 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8b504237-d32d-4f0f-a2a6-87c627823c8c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:46.035000 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8b504237-d32d-4f0f-a2a6-87c627823c8c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:46.035866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8b504237-d32d-4f0f-a2a6-87c627823c8c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:46.036513 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8b504237-d32d-4f0f-a2a6-87c627823c8c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:46.037096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8b504237-d32d-4f0f-a2a6-87c627823c8c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:46.280687 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8b504237-d32d-4f0f-a2a6-87c627823c8c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:46.291683 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8b504237-d32d-4f0f-a2a6-87c627823c8c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1368 microversion: 2.1 time: 0.269191 Aug 29 20:41:46.292339 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 474/927] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:46 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1368 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:46.434537 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-042ceb81-c95b-4140-b34c-b85f2b930b24 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:46.435328 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-042ceb81-c95b-4140-b34c-b85f2b930b24 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:46.442080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-042ceb81-c95b-4140-b34c-b85f2b930b24 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:46.442650 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-042ceb81-c95b-4140-b34c-b85f2b930b24 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:46.443148 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-042ceb81-c95b-4140-b34c-b85f2b930b24 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:46.443911 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-042ceb81-c95b-4140-b34c-b85f2b930b24 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:46.444388 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-042ceb81-c95b-4140-b34c-b85f2b930b24 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:46.444804 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-042ceb81-c95b-4140-b34c-b85f2b930b24 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:46.585711 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-042ceb81-c95b-4140-b34c-b85f2b930b24 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:46.594502 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-042ceb81-c95b-4140-b34c-b85f2b930b24 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1278 microversion: 2.1 time: 0.164267 Aug 29 20:41:46.595062 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 454/928] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:46 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:47.315905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2c55839a-9afb-4f72-b9fe-b36a0c4ae69d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:47.316565 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2c55839a-9afb-4f72-b9fe-b36a0c4ae69d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:47.323364 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c55839a-9afb-4f72-b9fe-b36a0c4ae69d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:47.323847 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c55839a-9afb-4f72-b9fe-b36a0c4ae69d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:47.324388 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c55839a-9afb-4f72-b9fe-b36a0c4ae69d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:47.325227 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c55839a-9afb-4f72-b9fe-b36a0c4ae69d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:47.325860 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c55839a-9afb-4f72-b9fe-b36a0c4ae69d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:47.326285 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2c55839a-9afb-4f72-b9fe-b36a0c4ae69d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:47.534499 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2c55839a-9afb-4f72-b9fe-b36a0c4ae69d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:47.545765 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2c55839a-9afb-4f72-b9fe-b36a0c4ae69d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1368 microversion: 2.1 time: 0.233940 Aug 29 20:41:47.546652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 475/929] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:47 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:47.614987 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-55601377-fdf5-4f5e-8549-82bc742fc820 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:47.616148 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-55601377-fdf5-4f5e-8549-82bc742fc820 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:47.624095 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55601377-fdf5-4f5e-8549-82bc742fc820 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:47.624954 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55601377-fdf5-4f5e-8549-82bc742fc820 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:47.625554 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55601377-fdf5-4f5e-8549-82bc742fc820 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:47.626277 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55601377-fdf5-4f5e-8549-82bc742fc820 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:47.626732 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55601377-fdf5-4f5e-8549-82bc742fc820 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:47.627158 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-55601377-fdf5-4f5e-8549-82bc742fc820 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:47.801855 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-556d26c3-63a3-4b87-8a5c-72738419ff29 req-93991ca1-ce04-416e-9f98-6c3e48d81230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f471db5-7c30-4af1-ac30-ca19749b20de", "tag": "4b1ee9cb-0447-4a61-8f14-6989ad0a92df"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:47.816532 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-556d26c3-63a3-4b87-8a5c-72738419ff29 req-93991ca1-ce04-416e-9f98-6c3e48d81230 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:47.817306 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-556d26c3-63a3-4b87-8a5c-72738419ff29 req-93991ca1-ce04-416e-9f98-6c3e48d81230 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:47.817936 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-556d26c3-63a3-4b87-8a5c-72738419ff29 req-93991ca1-ce04-416e-9f98-6c3e48d81230 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:47.831002 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-556d26c3-63a3-4b87-8a5c-72738419ff29 req-93991ca1-ce04-416e-9f98-6c3e48d81230 service nova] Creating event network-changed:4b1ee9cb-0447-4a61-8f14-6989ad0a92df for instance 6f471db5-7c30-4af1-ac30-ca19749b20de on hv-cinder-85426 Aug 29 20:41:47.837687 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-556d26c3-63a3-4b87-8a5c-72738419ff29 req-93991ca1-ce04-416e-9f98-6c3e48d81230 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042114 Aug 29 20:41:47.838202 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 476/930] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:41:47.859450 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-55601377-fdf5-4f5e-8549-82bc742fc820 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:47.867863 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-55601377-fdf5-4f5e-8549-82bc742fc820 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1266 microversion: 2.1 time: 0.257061 Aug 29 20:41:47.868510 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 455/931] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:47 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:47.956100 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7bd5840c-85f6-4dd4-a57e-a4910e9670b6 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:47.957067 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7bd5840c-85f6-4dd4-a57e-a4910e9670b6 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:47.965388 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7bd5840c-85f6-4dd4-a57e-a4910e9670b6 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:47.966226 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7bd5840c-85f6-4dd4-a57e-a4910e9670b6 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:47.966904 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7bd5840c-85f6-4dd4-a57e-a4910e9670b6 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:47.967699 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7bd5840c-85f6-4dd4-a57e-a4910e9670b6 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:47.968260 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7bd5840c-85f6-4dd4-a57e-a4910e9670b6 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:47.968854 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7bd5840c-85f6-4dd4-a57e-a4910e9670b6 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:48.012321 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7bd5840c-85f6-4dd4-a57e-a4910e9670b6 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Going to try to terminate instance {{(pid=127027) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:41:48.107282 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7bd5840c-85f6-4dd4-a57e-a4910e9670b6 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "DELETE /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 204 len: 0 microversion: 2.1 time: 0.155727 Aug 29 20:41:48.108112 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 477/932] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:41:47 2022] DELETE /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:41:48.116356 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-37e869da-6b63-48ba-876c-6673fbdfa325 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:48.117295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-37e869da-6b63-48ba-876c-6673fbdfa325 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:48.123272 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e869da-6b63-48ba-876c-6673fbdfa325 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:48.123841 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e869da-6b63-48ba-876c-6673fbdfa325 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:48.124382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e869da-6b63-48ba-876c-6673fbdfa325 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:48.125168 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e869da-6b63-48ba-876c-6673fbdfa325 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:48.125778 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e869da-6b63-48ba-876c-6673fbdfa325 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:48.126270 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-37e869da-6b63-48ba-876c-6673fbdfa325 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:48.259376 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-37e869da-6b63-48ba-876c-6673fbdfa325 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:48.267851 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-37e869da-6b63-48ba-876c-6673fbdfa325 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 200 len: 1512 microversion: 2.1 time: 0.155626 Aug 29 20:41:48.268500 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 456/933] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:48 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:48.572399 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-95a53885-81f6-44c2-8543-77ba6836a6a0 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:48.573097 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-95a53885-81f6-44c2-8543-77ba6836a6a0 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:48.579497 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-95a53885-81f6-44c2-8543-77ba6836a6a0 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:48.580068 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-95a53885-81f6-44c2-8543-77ba6836a6a0 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:48.580506 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-95a53885-81f6-44c2-8543-77ba6836a6a0 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:48.581199 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-95a53885-81f6-44c2-8543-77ba6836a6a0 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:48.581652 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-95a53885-81f6-44c2-8543-77ba6836a6a0 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:48.582075 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-95a53885-81f6-44c2-8543-77ba6836a6a0 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:48.725745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-95a53885-81f6-44c2-8543-77ba6836a6a0 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:48.733972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-95a53885-81f6-44c2-8543-77ba6836a6a0 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1368 microversion: 2.1 time: 0.166464 Aug 29 20:41:48.734649 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 478/934] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:48 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:48.890964 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-45afa98e-329e-48a3-b2a0-5b80fd876167 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:48.891488 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-45afa98e-329e-48a3-b2a0-5b80fd876167 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:48.898100 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45afa98e-329e-48a3-b2a0-5b80fd876167 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:48.898583 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45afa98e-329e-48a3-b2a0-5b80fd876167 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:48.899037 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45afa98e-329e-48a3-b2a0-5b80fd876167 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:48.899766 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45afa98e-329e-48a3-b2a0-5b80fd876167 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:48.900325 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45afa98e-329e-48a3-b2a0-5b80fd876167 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:48.900889 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-45afa98e-329e-48a3-b2a0-5b80fd876167 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:49.035776 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-45afa98e-329e-48a3-b2a0-5b80fd876167 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:49.044570 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-45afa98e-329e-48a3-b2a0-5b80fd876167 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1266 microversion: 2.1 time: 0.157477 Aug 29 20:41:49.045295 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 457/935] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:48 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:41:49.292620 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-731bfa2a-5a1e-4db5-89d6-2bf98764d646 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:49.293392 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-731bfa2a-5a1e-4db5-89d6-2bf98764d646 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:49.299518 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-731bfa2a-5a1e-4db5-89d6-2bf98764d646 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:49.300218 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-731bfa2a-5a1e-4db5-89d6-2bf98764d646 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:49.300789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-731bfa2a-5a1e-4db5-89d6-2bf98764d646 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:49.301501 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-731bfa2a-5a1e-4db5-89d6-2bf98764d646 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:49.301962 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-731bfa2a-5a1e-4db5-89d6-2bf98764d646 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:49.302384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-731bfa2a-5a1e-4db5-89d6-2bf98764d646 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:49.435084 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-731bfa2a-5a1e-4db5-89d6-2bf98764d646 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:49.443402 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-731bfa2a-5a1e-4db5-89d6-2bf98764d646 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 200 len: 1512 microversion: 2.1 time: 0.157490 Aug 29 20:41:49.443997 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 479/936] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:49 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:49.754675 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ef20077e-0252-4633-9259-a68b12036d6b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:49.755314 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-ef20077e-0252-4633-9259-a68b12036d6b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:49.761832 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef20077e-0252-4633-9259-a68b12036d6b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:49.762310 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef20077e-0252-4633-9259-a68b12036d6b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:49.762738 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef20077e-0252-4633-9259-a68b12036d6b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:49.763428 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef20077e-0252-4633-9259-a68b12036d6b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:49.763875 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef20077e-0252-4633-9259-a68b12036d6b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:49.764325 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-ef20077e-0252-4633-9259-a68b12036d6b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:49.896922 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-ef20077e-0252-4633-9259-a68b12036d6b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:49.905158 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ef20077e-0252-4633-9259-a68b12036d6b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1368 microversion: 2.1 time: 0.154358 Aug 29 20:41:49.905824 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 458/937] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:49 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:50.066160 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7666b3ee-be78-4d06-952a-bf4e40cf1791 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:50.066776 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7666b3ee-be78-4d06-952a-bf4e40cf1791 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:50.069242 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:50.077525 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7666b3ee-be78-4d06-952a-bf4e40cf1791 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:50.078022 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7666b3ee-be78-4d06-952a-bf4e40cf1791 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:50.078456 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7666b3ee-be78-4d06-952a-bf4e40cf1791 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:50.079195 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7666b3ee-be78-4d06-952a-bf4e40cf1791 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:50.080806 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7666b3ee-be78-4d06-952a-bf4e40cf1791 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:50.080806 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7666b3ee-be78-4d06-952a-bf4e40cf1791 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:50.311033 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7666b3ee-be78-4d06-952a-bf4e40cf1791 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:50.322636 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7666b3ee-be78-4d06-952a-bf4e40cf1791 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1266 microversion: 2.1 time: 0.260115 Aug 29 20:41:50.337711 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 480/938] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:50 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:50.467340 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a5a6fb01-5bd1-4e6a-a4e6-c1139236bf1a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:50.468374 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a5a6fb01-5bd1-4e6a-a4e6-c1139236bf1a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:50.479592 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5a6fb01-5bd1-4e6a-a4e6-c1139236bf1a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:50.480460 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5a6fb01-5bd1-4e6a-a4e6-c1139236bf1a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:50.481865 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5a6fb01-5bd1-4e6a-a4e6-c1139236bf1a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:50.483760 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5a6fb01-5bd1-4e6a-a4e6-c1139236bf1a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:50.485474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5a6fb01-5bd1-4e6a-a4e6-c1139236bf1a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:50.488031 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a5a6fb01-5bd1-4e6a-a4e6-c1139236bf1a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:50.691143 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a5a6fb01-5bd1-4e6a-a4e6-c1139236bf1a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:50.699338 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a5a6fb01-5bd1-4e6a-a4e6-c1139236bf1a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 200 len: 1512 microversion: 2.1 time: 0.237268 Aug 29 20:41:50.700038 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 459/939] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:50 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:50.807034 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-ad2079e9-a58d-4131-8f48-6cf2b7028468 req-e584fe3b-78f6-4218-975e-de7e4d592422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f00e48-ce6f-46e3-9c3f-843ad53c1e17", "name": "network-vif-deleted", "tag": "965dfd7e-6945-4afe-8e3c-f9f76a73a0ae"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:50.817515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-ad2079e9-a58d-4131-8f48-6cf2b7028468 req-e584fe3b-78f6-4218-975e-de7e4d592422 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:50.818000 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-ad2079e9-a58d-4131-8f48-6cf2b7028468 req-e584fe3b-78f6-4218-975e-de7e4d592422 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:50.818429 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-ad2079e9-a58d-4131-8f48-6cf2b7028468 req-e584fe3b-78f6-4218-975e-de7e4d592422 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:50.833643 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-ad2079e9-a58d-4131-8f48-6cf2b7028468 req-e584fe3b-78f6-4218-975e-de7e4d592422 service nova] Creating event network-vif-deleted:965dfd7e-6945-4afe-8e3c-f9f76a73a0ae for instance 73f00e48-ce6f-46e3-9c3f-843ad53c1e17 on hv-cinder-85426 Aug 29 20:41:50.840873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-ad2079e9-a58d-4131-8f48-6cf2b7028468 req-e584fe3b-78f6-4218-975e-de7e4d592422 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037368 Aug 29 20:41:50.841676 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 481/940] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:41:50.925495 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8951d39b-b27f-43f9-b10b-d02b0c4a962a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:50.926744 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8951d39b-b27f-43f9-b10b-d02b0c4a962a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:50.933121 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8951d39b-b27f-43f9-b10b-d02b0c4a962a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:50.933602 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8951d39b-b27f-43f9-b10b-d02b0c4a962a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:50.934042 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8951d39b-b27f-43f9-b10b-d02b0c4a962a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:50.934754 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8951d39b-b27f-43f9-b10b-d02b0c4a962a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:50.935211 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8951d39b-b27f-43f9-b10b-d02b0c4a962a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:50.935638 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8951d39b-b27f-43f9-b10b-d02b0c4a962a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:51.093730 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8951d39b-b27f-43f9-b10b-d02b0c4a962a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:51.101407 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8951d39b-b27f-43f9-b10b-d02b0c4a962a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1368 microversion: 2.1 time: 0.179706 Aug 29 20:41:51.101962 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 460/941] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:50 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:51.346058 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4cb5b197-8d87-4ec2-9ad3-a7eba71a7325 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:51.346881 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4cb5b197-8d87-4ec2-9ad3-a7eba71a7325 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:51.354360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4cb5b197-8d87-4ec2-9ad3-a7eba71a7325 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:51.354769 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4cb5b197-8d87-4ec2-9ad3-a7eba71a7325 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:51.355250 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4cb5b197-8d87-4ec2-9ad3-a7eba71a7325 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:51.355991 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4cb5b197-8d87-4ec2-9ad3-a7eba71a7325 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:51.356708 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4cb5b197-8d87-4ec2-9ad3-a7eba71a7325 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:51.356879 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4cb5b197-8d87-4ec2-9ad3-a7eba71a7325 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:51.517175 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4cb5b197-8d87-4ec2-9ad3-a7eba71a7325 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:51.530614 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4cb5b197-8d87-4ec2-9ad3-a7eba71a7325 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1266 microversion: 2.1 time: 0.189454 Aug 29 20:41:51.531968 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 482/942] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:51 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:51.722507 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f7e827de-eade-4c7e-bd98-44f03aebe663 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:51.723100 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f7e827de-eade-4c7e-bd98-44f03aebe663 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: 73f00e48-ce6f-46e3-9c3f-843ad53c1e17] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:51.730427 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7e827de-eade-4c7e-bd98-44f03aebe663 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:51.730922 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7e827de-eade-4c7e-bd98-44f03aebe663 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:51.731366 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7e827de-eade-4c7e-bd98-44f03aebe663 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:51.732114 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7e827de-eade-4c7e-bd98-44f03aebe663 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:51.732573 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7e827de-eade-4c7e-bd98-44f03aebe663 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:51.732997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f7e827de-eade-4c7e-bd98-44f03aebe663 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:51.747301 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-f7e827de-eade-4c7e-bd98-44f03aebe663 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] HTTP exception thrown: Instance 73f00e48-ce6f-46e3-9c3f-843ad53c1e17 could not be found. Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f7e827de-eade-4c7e-bd98-44f03aebe663 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Request method failure captured: Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 HTTP/1.1 Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSRO2eEq_i5KBuuISzh6C58bnFfj-3cHKDXQqgo_buIa2l69PEDIn7XmdHFocBWr1qel2sCCGHdPV75W-Tgg87yh8719P58EAcjvNmM5f2Rjz8UZv91qrgKqZhchNk2hk0vW-Pa_YVV2txnlyexWG3eRB3jYu48wklSwSdQPHpNo8e0 Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 732a8a55dfbd44afa826eb6f5571aabf Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1254344129 Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:41:51.749284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:41:51.751736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/732a8a55dfbd44afa826eb6f5571aabf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/732a8a55dfbd44afa826eb6f5571aabf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/732a8a55dfbd44afa826eb6f5571aabf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_732a8a55dfbd44afa826eb6f5571aabf"}]}] Aug 29 20:41:51.751736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-VolumesSnapshotTestJSON-1254344129 Aug 29 20:41:51.751736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 732a8a55dfbd44afa826eb6f5571aabf Aug 29 20:41:51.751736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1254344129 Aug 29 20:41:51.751736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-VolumesSnapshotTestJSON-1254344129-project Aug 29 20:41:51.751736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:41:51.751736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:41:51.751736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 037a2fa230a840cbaf876540632aeafa Aug 29 20:41:51.751736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-VolumesSnapshotTestJSON-1254344129-project Aug 29 20:41:51.751736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:41:51.751736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance 73f00e48-ce6f-46e3-9c3f-843ad53c1e17 could not be found. Aug 29 20:41:51.751736 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '73f00e48-ce6f-46e3-9c3f-843ad53c1e17'} Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f00e48-ce6f-46e3-9c3f-843ad53c1e17 could not be found. Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:41:51.752705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f00e48-ce6f-46e3-9c3f-843ad53c1e17 could not be found. Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f00e48-ce6f-46e3-9c3f-843ad53c1e17 could not be found. Aug 29 20:41:51.753952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:41:51.756186 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f7e827de-eade-4c7e-bd98-44f03aebe663 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Returning 404 to user: Instance 73f00e48-ce6f-46e3-9c3f-843ad53c1e17 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:41:51.756186 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f7e827de-eade-4c7e-bd98-44f03aebe663 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17" status: 404 len: 111 microversion: 2.1 time: 0.032470 Aug 29 20:41:51.756186 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 461/943] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:51 2022] GET /compute/v2.1/servers/73f00e48-ce6f-46e3-9c3f-843ad53c1e17 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:41:52.122780 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7429ae00-66a8-401d-b9b7-abbce81dffe1 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:52.123454 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7429ae00-66a8-401d-b9b7-abbce81dffe1 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:52.129895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7429ae00-66a8-401d-b9b7-abbce81dffe1 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:52.130422 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7429ae00-66a8-401d-b9b7-abbce81dffe1 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:52.130905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7429ae00-66a8-401d-b9b7-abbce81dffe1 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:52.131709 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7429ae00-66a8-401d-b9b7-abbce81dffe1 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:52.132287 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7429ae00-66a8-401d-b9b7-abbce81dffe1 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:52.132773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7429ae00-66a8-401d-b9b7-abbce81dffe1 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:52.275085 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-7429ae00-66a8-401d-b9b7-abbce81dffe1 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:52.283375 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7429ae00-66a8-401d-b9b7-abbce81dffe1 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1368 microversion: 2.1 time: 0.164658 Aug 29 20:41:52.283977 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 483/944] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:52 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:52.552227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-780c371c-82ed-4341-bffa-f5542b74662c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:52.553081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-780c371c-82ed-4341-bffa-f5542b74662c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:52.559793 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-780c371c-82ed-4341-bffa-f5542b74662c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:52.560313 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-780c371c-82ed-4341-bffa-f5542b74662c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:52.560745 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-780c371c-82ed-4341-bffa-f5542b74662c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:52.561444 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-780c371c-82ed-4341-bffa-f5542b74662c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:52.561893 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-780c371c-82ed-4341-bffa-f5542b74662c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:52.562315 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-780c371c-82ed-4341-bffa-f5542b74662c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:52.718026 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-780c371c-82ed-4341-bffa-f5542b74662c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:52.729946 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-780c371c-82ed-4341-bffa-f5542b74662c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1266 microversion: 2.1 time: 0.181361 Aug 29 20:41:52.730769 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 462/945] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:52 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:41:53.309589 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-c883abb6-1368-4f88-a06a-5c47af31b399 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:53.310571 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-c883abb6-1368-4f88-a06a-5c47af31b399 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:53.318056 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c883abb6-1368-4f88-a06a-5c47af31b399 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:53.318536 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c883abb6-1368-4f88-a06a-5c47af31b399 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:53.318977 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c883abb6-1368-4f88-a06a-5c47af31b399 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:53.319695 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c883abb6-1368-4f88-a06a-5c47af31b399 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:53.320191 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c883abb6-1368-4f88-a06a-5c47af31b399 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:53.320617 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c883abb6-1368-4f88-a06a-5c47af31b399 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:53.457874 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-c883abb6-1368-4f88-a06a-5c47af31b399 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:53.465762 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c883abb6-1368-4f88-a06a-5c47af31b399 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1368 microversion: 2.1 time: 0.162341 Aug 29 20:41:53.466387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 484/946] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:53 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:53.751399 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-05cfc041-2fcf-44e4-b67e-d47ded2b48b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:53.751972 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-05cfc041-2fcf-44e4-b67e-d47ded2b48b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:53.758450 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05cfc041-2fcf-44e4-b67e-d47ded2b48b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:53.759540 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05cfc041-2fcf-44e4-b67e-d47ded2b48b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:53.760078 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05cfc041-2fcf-44e4-b67e-d47ded2b48b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:53.761000 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05cfc041-2fcf-44e4-b67e-d47ded2b48b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:53.761163 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05cfc041-2fcf-44e4-b67e-d47ded2b48b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:53.761587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05cfc041-2fcf-44e4-b67e-d47ded2b48b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:53.911666 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=4 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:53.948330 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=12 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:54.189365 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-05cfc041-2fcf-44e4-b67e-d47ded2b48b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:54.202995 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-05cfc041-2fcf-44e4-b67e-d47ded2b48b9 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1266 microversion: 2.1 time: 0.455240 Aug 29 20:41:54.203983 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 463/947] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:53 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1266 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:54.488455 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a972bf93-ff35-454c-be79-15e68b61d539 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:54.489460 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a972bf93-ff35-454c-be79-15e68b61d539 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:54.491806 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=8 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:54.499465 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a972bf93-ff35-454c-be79-15e68b61d539 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:54.500139 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a972bf93-ff35-454c-be79-15e68b61d539 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:54.500693 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a972bf93-ff35-454c-be79-15e68b61d539 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:54.501498 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a972bf93-ff35-454c-be79-15e68b61d539 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:54.502206 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a972bf93-ff35-454c-be79-15e68b61d539 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:54.502732 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a972bf93-ff35-454c-be79-15e68b61d539 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:54.523604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-8202e875-61cf-45be-9e63-b00e9c5ebe95 req-cad8af3e-7c59-47c3-bdf1-c479016b7c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea03034-17ef-42a5-af06-60d8e43be248", "name": "network-vif-plugged", "status": "completed", "tag": "7dac8a78-45b2-4c8a-a9c8-11b8dddbb08a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:54.533884 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8202e875-61cf-45be-9e63-b00e9c5ebe95 req-cad8af3e-7c59-47c3-bdf1-c479016b7c9b service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:54.534361 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8202e875-61cf-45be-9e63-b00e9c5ebe95 req-cad8af3e-7c59-47c3-bdf1-c479016b7c9b service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:54.534792 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-8202e875-61cf-45be-9e63-b00e9c5ebe95 req-cad8af3e-7c59-47c3-bdf1-c479016b7c9b service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:54.547569 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-8202e875-61cf-45be-9e63-b00e9c5ebe95 req-cad8af3e-7c59-47c3-bdf1-c479016b7c9b service nova] Creating event network-vif-plugged:7dac8a78-45b2-4c8a-a9c8-11b8dddbb08a for instance 2ea03034-17ef-42a5-af06-60d8e43be248 on hv-cinder-85426 Aug 29 20:41:54.553882 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-8202e875-61cf-45be-9e63-b00e9c5ebe95 req-cad8af3e-7c59-47c3-bdf1-c479016b7c9b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033795 Aug 29 20:41:54.554990 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 464/948] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:41:54.716655 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a972bf93-ff35-454c-be79-15e68b61d539 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:54.724602 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a972bf93-ff35-454c-be79-15e68b61d539 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1368 microversion: 2.1 time: 0.240885 Aug 29 20:41:54.725164 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 485/949] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:54 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:41:55.240641 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-77faa291-0237-4f69-877a-c305c7798390 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:55.241339 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-77faa291-0237-4f69-877a-c305c7798390 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:55.248164 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77faa291-0237-4f69-877a-c305c7798390 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:55.248635 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77faa291-0237-4f69-877a-c305c7798390 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:55.249068 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77faa291-0237-4f69-877a-c305c7798390 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:55.249767 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77faa291-0237-4f69-877a-c305c7798390 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:55.250224 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77faa291-0237-4f69-877a-c305c7798390 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:55.250655 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-77faa291-0237-4f69-877a-c305c7798390 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:55.393339 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-77faa291-0237-4f69-877a-c305c7798390 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:55.402404 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-77faa291-0237-4f69-877a-c305c7798390 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1266 microversion: 2.1 time: 0.167017 Aug 29 20:41:55.403139 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 465/950] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:55 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:55.748094 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-06138940-f368-42ea-9b2b-ae87e2666390 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:55.748737 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-06138940-f368-42ea-9b2b-ae87e2666390 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:55.755576 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-06138940-f368-42ea-9b2b-ae87e2666390 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:55.756208 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-06138940-f368-42ea-9b2b-ae87e2666390 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:55.756775 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-06138940-f368-42ea-9b2b-ae87e2666390 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:55.757777 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-06138940-f368-42ea-9b2b-ae87e2666390 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:55.758352 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-06138940-f368-42ea-9b2b-ae87e2666390 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:55.759327 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-06138940-f368-42ea-9b2b-ae87e2666390 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:55.907183 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-06138940-f368-42ea-9b2b-ae87e2666390 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:55.915566 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-06138940-f368-42ea-9b2b-ae87e2666390 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1368 microversion: 2.1 time: 0.173058 Aug 29 20:41:55.916259 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 486/951] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:55 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:56.423494 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3308a661-63aa-4b38-8093-f5b0dc9e0c77 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:56.424619 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3308a661-63aa-4b38-8093-f5b0dc9e0c77 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:56.431761 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3308a661-63aa-4b38-8093-f5b0dc9e0c77 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:56.432412 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3308a661-63aa-4b38-8093-f5b0dc9e0c77 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:56.432857 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3308a661-63aa-4b38-8093-f5b0dc9e0c77 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:56.433944 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3308a661-63aa-4b38-8093-f5b0dc9e0c77 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:56.434117 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3308a661-63aa-4b38-8093-f5b0dc9e0c77 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:56.434450 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3308a661-63aa-4b38-8093-f5b0dc9e0c77 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:56.600782 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-3308a661-63aa-4b38-8093-f5b0dc9e0c77 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:56.611401 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3308a661-63aa-4b38-8093-f5b0dc9e0c77 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1266 microversion: 2.1 time: 0.192393 Aug 29 20:41:56.611995 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 466/952] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:56 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:41:56.937005 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a294af3b-9177-416c-bc51-0116e16286f7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:56.937698 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a294af3b-9177-416c-bc51-0116e16286f7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:56.947739 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a294af3b-9177-416c-bc51-0116e16286f7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:56.948529 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a294af3b-9177-416c-bc51-0116e16286f7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:56.949183 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a294af3b-9177-416c-bc51-0116e16286f7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:56.950254 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a294af3b-9177-416c-bc51-0116e16286f7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:56.951191 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a294af3b-9177-416c-bc51-0116e16286f7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:56.951836 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a294af3b-9177-416c-bc51-0116e16286f7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:57.120119 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a294af3b-9177-416c-bc51-0116e16286f7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:57.123504 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:57.128636 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a294af3b-9177-416c-bc51-0116e16286f7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1368 microversion: 2.1 time: 0.195574 Aug 29 20:41:57.129208 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 487/953] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:56 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:41:57.631844 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4e8236a5-f3fc-4683-92c4-2e0c343f2f8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:57.632489 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4e8236a5-f3fc-4683-92c4-2e0c343f2f8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:57.640080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e8236a5-f3fc-4683-92c4-2e0c343f2f8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:57.640570 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e8236a5-f3fc-4683-92c4-2e0c343f2f8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:57.641010 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e8236a5-f3fc-4683-92c4-2e0c343f2f8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:57.641714 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e8236a5-f3fc-4683-92c4-2e0c343f2f8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:57.642170 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e8236a5-f3fc-4683-92c4-2e0c343f2f8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:57.642609 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4e8236a5-f3fc-4683-92c4-2e0c343f2f8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:57.818305 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-4e8236a5-f3fc-4683-92c4-2e0c343f2f8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:57.826196 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4e8236a5-f3fc-4683-92c4-2e0c343f2f8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1266 microversion: 2.1 time: 0.198261 Aug 29 20:41:57.826766 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 467/954] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:57 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:58.150796 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4fb3cc0a-5254-491f-81c6-a71af41057e6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:58.151356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4fb3cc0a-5254-491f-81c6-a71af41057e6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:58.159404 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fb3cc0a-5254-491f-81c6-a71af41057e6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:58.160059 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fb3cc0a-5254-491f-81c6-a71af41057e6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:58.160515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fb3cc0a-5254-491f-81c6-a71af41057e6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:58.161314 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fb3cc0a-5254-491f-81c6-a71af41057e6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:58.161916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fb3cc0a-5254-491f-81c6-a71af41057e6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:58.162338 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4fb3cc0a-5254-491f-81c6-a71af41057e6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:58.569258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4fb3cc0a-5254-491f-81c6-a71af41057e6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:58.577642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4fb3cc0a-5254-491f-81c6-a71af41057e6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1557 microversion: 2.1 time: 0.431318 Aug 29 20:41:58.578622 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 488/955] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:58 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1557 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:58.607631 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6dc53d64-2454-4272-a350-ac9664931942 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:58.608189 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6dc53d64-2454-4272-a350-ac9664931942 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:58.614229 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dc53d64-2454-4272-a350-ac9664931942 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:58.614704 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dc53d64-2454-4272-a350-ac9664931942 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:58.615139 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dc53d64-2454-4272-a350-ac9664931942 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:58.615833 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dc53d64-2454-4272-a350-ac9664931942 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:58.616373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dc53d64-2454-4272-a350-ac9664931942 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:58.616797 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6dc53d64-2454-4272-a350-ac9664931942 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:58.647585 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:58.737448 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6dc53d64-2454-4272-a350-ac9664931942 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134063 Aug 29 20:41:58.738080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 468/956] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 29 20:41:58 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:41:58.850835 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-47d21c00-bf79-4a99-bb55-130888b99ed4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:41:58.852031 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-47d21c00-bf79-4a99-bb55-130888b99ed4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:41:58.862799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47d21c00-bf79-4a99-bb55-130888b99ed4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:58.863663 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47d21c00-bf79-4a99-bb55-130888b99ed4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:58.864470 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47d21c00-bf79-4a99-bb55-130888b99ed4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:58.865731 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47d21c00-bf79-4a99-bb55-130888b99ed4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:58.866542 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47d21c00-bf79-4a99-bb55-130888b99ed4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:58.867311 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47d21c00-bf79-4a99-bb55-130888b99ed4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:59.067001 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-47d21c00-bf79-4a99-bb55-130888b99ed4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:41:59.079993 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-47d21c00-bf79-4a99-bb55-130888b99ed4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1266 microversion: 2.1 time: 0.236279 Aug 29 20:41:59.080878 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 489/957] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:41:58 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:41:59.838866 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-39f0e733-7b74-4f25-9e56-23dabd9353fa req-327460a4-939a-422f-aad5-883675aee185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ea03034-17ef-42a5-af06-60d8e43be248", "tag": "7dac8a78-45b2-4c8a-a9c8-11b8dddbb08a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:41:59.855672 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-39f0e733-7b74-4f25-9e56-23dabd9353fa req-327460a4-939a-422f-aad5-883675aee185 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:41:59.856559 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-39f0e733-7b74-4f25-9e56-23dabd9353fa req-327460a4-939a-422f-aad5-883675aee185 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:41:59.857314 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-39f0e733-7b74-4f25-9e56-23dabd9353fa req-327460a4-939a-422f-aad5-883675aee185 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:41:59.879248 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-39f0e733-7b74-4f25-9e56-23dabd9353fa req-327460a4-939a-422f-aad5-883675aee185 service nova] Creating event network-changed:7dac8a78-45b2-4c8a-a9c8-11b8dddbb08a for instance 2ea03034-17ef-42a5-af06-60d8e43be248 on hv-cinder-85426 Aug 29 20:41:59.886606 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-39f0e733-7b74-4f25-9e56-23dabd9353fa req-327460a4-939a-422f-aad5-883675aee185 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055992 Aug 29 20:41:59.887523 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 469/958] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:42:00.100750 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a23429c4-538b-47eb-bc3f-f7d4067b4765 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:00.101643 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a23429c4-538b-47eb-bc3f-f7d4067b4765 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:00.108935 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a23429c4-538b-47eb-bc3f-f7d4067b4765 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:00.109423 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a23429c4-538b-47eb-bc3f-f7d4067b4765 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:00.109858 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a23429c4-538b-47eb-bc3f-f7d4067b4765 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:00.110564 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a23429c4-538b-47eb-bc3f-f7d4067b4765 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:00.111023 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a23429c4-538b-47eb-bc3f-f7d4067b4765 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:00.111455 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a23429c4-538b-47eb-bc3f-f7d4067b4765 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:00.269009 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a23429c4-538b-47eb-bc3f-f7d4067b4765 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:00.278589 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a23429c4-538b-47eb-bc3f-f7d4067b4765 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1266 microversion: 2.1 time: 0.181555 Aug 29 20:42:00.279179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 490/959] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:00 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:01.310315 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4c625c51-27fc-44c7-a379-41e34b7a820d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:01.312453 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4c625c51-27fc-44c7-a379-41e34b7a820d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:01.322941 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c625c51-27fc-44c7-a379-41e34b7a820d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:01.323676 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c625c51-27fc-44c7-a379-41e34b7a820d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:01.324360 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c625c51-27fc-44c7-a379-41e34b7a820d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:01.325437 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c625c51-27fc-44c7-a379-41e34b7a820d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:01.326137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c625c51-27fc-44c7-a379-41e34b7a820d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:01.327134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c625c51-27fc-44c7-a379-41e34b7a820d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:01.533282 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-4c625c51-27fc-44c7-a379-41e34b7a820d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:01.542286 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4c625c51-27fc-44c7-a379-41e34b7a820d tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1266 microversion: 2.1 time: 0.237833 Aug 29 20:42:01.542286 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 470/960] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:01 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:01.828387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-397488817", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "networks": [{"uuid": "aabb81f8-a301-47ad-a66b-a8659a1137e5"}]}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:42:01.905202 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.network.neutron [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] validate_networks() for [('aabb81f8-a301-47ad-a66b-a8659a1137e5', None, None, None, None, None)] {{(pid=127027) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:42:02.510803 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Flavor limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:42:02.511225 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Image limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:42:02.511693 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Flavor pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:42:02.512156 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Image pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:42:02.512559 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:42:02.523990 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:02.524588 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:02.525020 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:02.525744 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:02.526190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:02.527249 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:02.547291 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Getting quotas for project 732a8a55dfbd44afa826eb6f5571aabf. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:42:02.552254 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Getting quotas for user 037a2fa230a840cbaf876540632aeafa and project 732a8a55dfbd44afa826eb6f5571aabf. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:42:02.565597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1783fab9-3136-4c6b-a27d-a1dc5f08fae2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:02.566714 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1783fab9-3136-4c6b-a27d-a1dc5f08fae2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:02.567560 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Going to run 1 instances... {{(pid=127027) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:42:02.569910 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:42:02.577261 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1783fab9-3136-4c6b-a27d-a1dc5f08fae2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:02.578126 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1783fab9-3136-4c6b-a27d-a1dc5f08fae2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:02.578898 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1783fab9-3136-4c6b-a27d-a1dc5f08fae2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:02.580203 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1783fab9-3136-4c6b-a27d-a1dc5f08fae2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:02.581023 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1783fab9-3136-4c6b-a27d-a1dc5f08fae2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:02.581791 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1783fab9-3136-4c6b-a27d-a1dc5f08fae2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:02.621572 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1efb8a8d-6742-4ba5-bded-5d6d9a8beba3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801316 Aug 29 20:42:02.629594 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 491/961] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:42:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 20:42:02.640471 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a1d9ce9b-6197-48c6-8901-f39e5070b3ef tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:02.641784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a1d9ce9b-6197-48c6-8901-f39e5070b3ef tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:02.710130 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a1d9ce9b-6197-48c6-8901-f39e5070b3ef tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:02.720411 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a1d9ce9b-6197-48c6-8901-f39e5070b3ef tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 200 len: 1218 microversion: 2.1 time: 0.086299 Aug 29 20:42:02.730737 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 492/962] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:02 2022] GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:02.799009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1783fab9-3136-4c6b-a27d-a1dc5f08fae2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:02.812011 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1783fab9-3136-4c6b-a27d-a1dc5f08fae2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1266 microversion: 2.1 time: 0.252825 Aug 29 20:42:02.819035 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 471/963] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:02 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:42:03.037228 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-dd5a31a8-2888-43a4-aa1d-b675a325d88f req-30fbec48-3c60-4850-a90f-8dcebd850f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f471db5-7c30-4af1-ac30-ca19749b20de", "name": "network-vif-plugged", "status": "completed", "tag": "4b1ee9cb-0447-4a61-8f14-6989ad0a92df"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:42:03.051373 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-dd5a31a8-2888-43a4-aa1d-b675a325d88f req-30fbec48-3c60-4850-a90f-8dcebd850f6d service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:03.051903 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-dd5a31a8-2888-43a4-aa1d-b675a325d88f req-30fbec48-3c60-4850-a90f-8dcebd850f6d service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:03.052644 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-dd5a31a8-2888-43a4-aa1d-b675a325d88f req-30fbec48-3c60-4850-a90f-8dcebd850f6d service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:03.066408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-dd5a31a8-2888-43a4-aa1d-b675a325d88f req-30fbec48-3c60-4850-a90f-8dcebd850f6d service nova] Creating event network-vif-plugged:4b1ee9cb-0447-4a61-8f14-6989ad0a92df for instance 6f471db5-7c30-4af1-ac30-ca19749b20de on hv-cinder-85426 Aug 29 20:42:03.080797 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-dd5a31a8-2888-43a4-aa1d-b675a325d88f req-30fbec48-3c60-4850-a90f-8dcebd850f6d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039589 Aug 29 20:42:03.081631 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 493/964] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:42:03.741720 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0b931e35-5ab0-4875-8b0b-281fa8fc3f8a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:03.742328 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0b931e35-5ab0-4875-8b0b-281fa8fc3f8a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:03.750149 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b931e35-5ab0-4875-8b0b-281fa8fc3f8a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:03.750637 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b931e35-5ab0-4875-8b0b-281fa8fc3f8a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:03.751065 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b931e35-5ab0-4875-8b0b-281fa8fc3f8a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:03.751758 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b931e35-5ab0-4875-8b0b-281fa8fc3f8a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:03.752271 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b931e35-5ab0-4875-8b0b-281fa8fc3f8a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:03.752684 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0b931e35-5ab0-4875-8b0b-281fa8fc3f8a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:03.816918 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-0b931e35-5ab0-4875-8b0b-281fa8fc3f8a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:03.824787 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0b931e35-5ab0-4875-8b0b-281fa8fc3f8a tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 200 len: 1270 microversion: 2.1 time: 0.086856 Aug 29 20:42:03.825359 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 472/965] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:03 2022] GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:03.847356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-5e2c767f-c655-4832-9793-99ebe13265e4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:03.847995 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-5e2c767f-c655-4832-9793-99ebe13265e4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:03.854972 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5e2c767f-c655-4832-9793-99ebe13265e4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:03.855462 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5e2c767f-c655-4832-9793-99ebe13265e4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:03.855897 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5e2c767f-c655-4832-9793-99ebe13265e4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:03.856642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5e2c767f-c655-4832-9793-99ebe13265e4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:03.857090 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5e2c767f-c655-4832-9793-99ebe13265e4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:03.857513 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-5e2c767f-c655-4832-9793-99ebe13265e4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:04.011237 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-5e2c767f-c655-4832-9793-99ebe13265e4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:04.019902 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-5e2c767f-c655-4832-9793-99ebe13265e4 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1266 microversion: 2.1 time: 0.177006 Aug 29 20:42:04.020510 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 494/966] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:03 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:04.854130 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-46a25cd7-bf31-4173-8f2d-9048d84bc138 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:04.856445 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-46a25cd7-bf31-4173-8f2d-9048d84bc138 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:04.869509 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46a25cd7-bf31-4173-8f2d-9048d84bc138 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:04.870374 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46a25cd7-bf31-4173-8f2d-9048d84bc138 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:04.871302 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46a25cd7-bf31-4173-8f2d-9048d84bc138 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:04.872691 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46a25cd7-bf31-4173-8f2d-9048d84bc138 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:04.873499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46a25cd7-bf31-4173-8f2d-9048d84bc138 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:04.874517 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-46a25cd7-bf31-4173-8f2d-9048d84bc138 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:04.947342 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-46a25cd7-bf31-4173-8f2d-9048d84bc138 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:04.955150 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-46a25cd7-bf31-4173-8f2d-9048d84bc138 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 200 len: 1278 microversion: 2.1 time: 0.110673 Aug 29 20:42:04.955708 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 473/967] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:04 2022] GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 1278 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:05.041792 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-fff409a8-d838-4f84-bac2-636d6a5774fd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:05.042391 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-fff409a8-d838-4f84-bac2-636d6a5774fd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:05.048390 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fff409a8-d838-4f84-bac2-636d6a5774fd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:05.048878 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fff409a8-d838-4f84-bac2-636d6a5774fd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:05.049311 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fff409a8-d838-4f84-bac2-636d6a5774fd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:05.050004 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fff409a8-d838-4f84-bac2-636d6a5774fd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:05.050462 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fff409a8-d838-4f84-bac2-636d6a5774fd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:05.050881 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-fff409a8-d838-4f84-bac2-636d6a5774fd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:05.220974 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-fff409a8-d838-4f84-bac2-636d6a5774fd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:05.235715 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-fff409a8-d838-4f84-bac2-636d6a5774fd tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1452 microversion: 2.1 time: 0.198750 Aug 29 20:42:05.236781 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 495/968] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:05 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1452 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:05.272971 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-86babc35-0de1-45ce-b9ab-38f9ce981b1e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:05.275068 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-86babc35-0de1-45ce-b9ab-38f9ce981b1e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:05.291619 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86babc35-0de1-45ce-b9ab-38f9ce981b1e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:05.300074 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86babc35-0de1-45ce-b9ab-38f9ce981b1e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:05.301918 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86babc35-0de1-45ce-b9ab-38f9ce981b1e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:05.304495 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86babc35-0de1-45ce-b9ab-38f9ce981b1e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:05.305326 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86babc35-0de1-45ce-b9ab-38f9ce981b1e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:05.306134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-86babc35-0de1-45ce-b9ab-38f9ce981b1e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:05.534256 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-86babc35-0de1-45ce-b9ab-38f9ce981b1e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:05.548835 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-86babc35-0de1-45ce-b9ab-38f9ce981b1e tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1452 microversion: 2.1 time: 0.282877 Aug 29 20:42:05.549892 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 474/969] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:05 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1452 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:42:05.976839 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6c47a69c-697d-4e00-8e31-0c5a08fe888d tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:05.978258 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6c47a69c-697d-4e00-8e31-0c5a08fe888d tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:05.985864 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c47a69c-697d-4e00-8e31-0c5a08fe888d tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:05.986744 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c47a69c-697d-4e00-8e31-0c5a08fe888d tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:05.987477 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c47a69c-697d-4e00-8e31-0c5a08fe888d tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:05.988386 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c47a69c-697d-4e00-8e31-0c5a08fe888d tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:05.988949 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c47a69c-697d-4e00-8e31-0c5a08fe888d tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:05.989515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c47a69c-697d-4e00-8e31-0c5a08fe888d tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:06.237278 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-6c47a69c-697d-4e00-8e31-0c5a08fe888d tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:06.245198 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6c47a69c-697d-4e00-8e31-0c5a08fe888d tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 200 len: 1318 microversion: 2.1 time: 0.272275 Aug 29 20:42:06.258392 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 496/970] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:05 2022] GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:06.835792 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-2fc084fc-3b01-4da1-8cc3-6656dde2a0ef req-af6ba24e-0025-4145-917a-382b7f5b4ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec60590b-210b-4d80-af3a-265de343cca0", "tag": "e14210f8-332e-4ea4-9e9b-6eca4b2c8f25"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:42:06.877993 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2fc084fc-3b01-4da1-8cc3-6656dde2a0ef req-af6ba24e-0025-4145-917a-382b7f5b4ebe service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:06.879275 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2fc084fc-3b01-4da1-8cc3-6656dde2a0ef req-af6ba24e-0025-4145-917a-382b7f5b4ebe service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:06.880155 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-2fc084fc-3b01-4da1-8cc3-6656dde2a0ef req-af6ba24e-0025-4145-917a-382b7f5b4ebe service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:06.903539 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-2fc084fc-3b01-4da1-8cc3-6656dde2a0ef req-af6ba24e-0025-4145-917a-382b7f5b4ebe service nova] Creating event network-changed:e14210f8-332e-4ea4-9e9b-6eca4b2c8f25 for instance ec60590b-210b-4d80-af3a-265de343cca0 on hv-cinder-85426 Aug 29 20:42:06.912452 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-2fc084fc-3b01-4da1-8cc3-6656dde2a0ef req-af6ba24e-0025-4145-917a-382b7f5b4ebe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084547 Aug 29 20:42:06.914274 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 475/971] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:42:07.266536 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-e648f6be-ec44-4c19-bdfa-f56a345853e7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:07.267275 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-e648f6be-ec44-4c19-bdfa-f56a345853e7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:07.279117 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e648f6be-ec44-4c19-bdfa-f56a345853e7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:07.279981 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e648f6be-ec44-4c19-bdfa-f56a345853e7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:07.280616 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e648f6be-ec44-4c19-bdfa-f56a345853e7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:07.281505 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e648f6be-ec44-4c19-bdfa-f56a345853e7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:07.282393 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e648f6be-ec44-4c19-bdfa-f56a345853e7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:07.282393 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-e648f6be-ec44-4c19-bdfa-f56a345853e7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:07.422207 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f4d317da-c4fa-4825-ab9e-4c8685bb68c7 req-100ea98e-fb4d-444f-a5d0-6e54b3258873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f471db5-7c30-4af1-ac30-ca19749b20de", "tag": "4b1ee9cb-0447-4a61-8f14-6989ad0a92df"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:42:07.432698 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f4d317da-c4fa-4825-ab9e-4c8685bb68c7 req-100ea98e-fb4d-444f-a5d0-6e54b3258873 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:07.433273 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f4d317da-c4fa-4825-ab9e-4c8685bb68c7 req-100ea98e-fb4d-444f-a5d0-6e54b3258873 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:07.433933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f4d317da-c4fa-4825-ab9e-4c8685bb68c7 req-100ea98e-fb4d-444f-a5d0-6e54b3258873 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:07.439897 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-e648f6be-ec44-4c19-bdfa-f56a345853e7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:07.447327 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f4d317da-c4fa-4825-ab9e-4c8685bb68c7 req-100ea98e-fb4d-444f-a5d0-6e54b3258873 service nova] Creating event network-changed:4b1ee9cb-0447-4a61-8f14-6989ad0a92df for instance 6f471db5-7c30-4af1-ac30-ca19749b20de on hv-cinder-85426 Aug 29 20:42:07.448940 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-e648f6be-ec44-4c19-bdfa-f56a345853e7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 200 len: 1318 microversion: 2.1 time: 0.186678 Aug 29 20:42:07.449806 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 497/972] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:07 2022] GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:07.465397 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f4d317da-c4fa-4825-ab9e-4c8685bb68c7 req-100ea98e-fb4d-444f-a5d0-6e54b3258873 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047414 Aug 29 20:42:07.466131 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 476/973] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:42:08.470601 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6132b3f2-a2ad-4ace-a721-2b5e3d9d2894 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:08.471967 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6132b3f2-a2ad-4ace-a721-2b5e3d9d2894 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:08.479885 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6132b3f2-a2ad-4ace-a721-2b5e3d9d2894 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:08.480744 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6132b3f2-a2ad-4ace-a721-2b5e3d9d2894 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:08.481572 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6132b3f2-a2ad-4ace-a721-2b5e3d9d2894 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:08.482713 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6132b3f2-a2ad-4ace-a721-2b5e3d9d2894 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:08.483430 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6132b3f2-a2ad-4ace-a721-2b5e3d9d2894 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:08.484092 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6132b3f2-a2ad-4ace-a721-2b5e3d9d2894 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:08.745903 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-6132b3f2-a2ad-4ace-a721-2b5e3d9d2894 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:08.755866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6132b3f2-a2ad-4ace-a721-2b5e3d9d2894 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 200 len: 1318 microversion: 2.1 time: 0.288953 Aug 29 20:42:08.756543 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 498/974] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:08 2022] GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:09.777965 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-1d79491e-62c3-4b71-98a5-f6c0298869f1 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:09.778685 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-1d79491e-62c3-4b71-98a5-f6c0298869f1 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:09.784936 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d79491e-62c3-4b71-98a5-f6c0298869f1 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:09.785609 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d79491e-62c3-4b71-98a5-f6c0298869f1 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:09.785862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d79491e-62c3-4b71-98a5-f6c0298869f1 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:09.786558 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d79491e-62c3-4b71-98a5-f6c0298869f1 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:09.787012 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d79491e-62c3-4b71-98a5-f6c0298869f1 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:09.787435 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-1d79491e-62c3-4b71-98a5-f6c0298869f1 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:09.915417 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-1d79491e-62c3-4b71-98a5-f6c0298869f1 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:09.923073 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-1d79491e-62c3-4b71-98a5-f6c0298869f1 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 200 len: 1318 microversion: 2.1 time: 0.149840 Aug 29 20:42:09.923632 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 477/975] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:09 2022] GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:10.944797 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a0805d2d-d00d-467a-8ac1-4f91a2ea62aa tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:10.945677 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a0805d2d-d00d-467a-8ac1-4f91a2ea62aa tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:10.952714 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a0805d2d-d00d-467a-8ac1-4f91a2ea62aa tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:10.953299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a0805d2d-d00d-467a-8ac1-4f91a2ea62aa tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:10.953809 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a0805d2d-d00d-467a-8ac1-4f91a2ea62aa tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:10.954522 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a0805d2d-d00d-467a-8ac1-4f91a2ea62aa tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:10.955118 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a0805d2d-d00d-467a-8ac1-4f91a2ea62aa tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:10.955582 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a0805d2d-d00d-467a-8ac1-4f91a2ea62aa tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:11.022041 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-646428a0-93ee-4ce5-93af-543b609d6946 req-ee5dfbd1-be7e-4189-8cfa-b697c7428dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec60590b-210b-4d80-af3a-265de343cca0", "name": "network-vif-plugged", "status": "completed", "tag": "e14210f8-332e-4ea4-9e9b-6eca4b2c8f25"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:42:11.033230 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-646428a0-93ee-4ce5-93af-543b609d6946 req-ee5dfbd1-be7e-4189-8cfa-b697c7428dd6 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:11.033934 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-646428a0-93ee-4ce5-93af-543b609d6946 req-ee5dfbd1-be7e-4189-8cfa-b697c7428dd6 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:11.034543 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-646428a0-93ee-4ce5-93af-543b609d6946 req-ee5dfbd1-be7e-4189-8cfa-b697c7428dd6 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:11.046730 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-646428a0-93ee-4ce5-93af-543b609d6946 req-ee5dfbd1-be7e-4189-8cfa-b697c7428dd6 service nova] Creating event network-vif-plugged:e14210f8-332e-4ea4-9e9b-6eca4b2c8f25 for instance ec60590b-210b-4d80-af3a-265de343cca0 on hv-cinder-85426 Aug 29 20:42:11.052122 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-646428a0-93ee-4ce5-93af-543b609d6946 req-ee5dfbd1-be7e-4189-8cfa-b697c7428dd6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034069 Aug 29 20:42:11.053261 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 478/976] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:42:11.090624 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-a0805d2d-d00d-467a-8ac1-4f91a2ea62aa tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:11.098718 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a0805d2d-d00d-467a-8ac1-4f91a2ea62aa tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 200 len: 1318 microversion: 2.1 time: 0.157962 Aug 29 20:42:11.099347 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 499/977] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:10 2022] GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:12.120983 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b700c17d-eb54-4da5-918e-96f1b9b0d146 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:12.121692 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b700c17d-eb54-4da5-918e-96f1b9b0d146 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:12.123667 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:12.129326 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b700c17d-eb54-4da5-918e-96f1b9b0d146 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:12.129833 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b700c17d-eb54-4da5-918e-96f1b9b0d146 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:12.130254 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b700c17d-eb54-4da5-918e-96f1b9b0d146 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:12.130962 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b700c17d-eb54-4da5-918e-96f1b9b0d146 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:12.131428 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b700c17d-eb54-4da5-918e-96f1b9b0d146 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:12.131852 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b700c17d-eb54-4da5-918e-96f1b9b0d146 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:12.275951 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-b700c17d-eb54-4da5-918e-96f1b9b0d146 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:12.284309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b700c17d-eb54-4da5-918e-96f1b9b0d146 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 200 len: 1318 microversion: 2.1 time: 0.168064 Aug 29 20:42:12.284903 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 479/978] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:12 2022] GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:13.305206 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b3eb6845-f5d0-4c3a-88f3-d3ffb4bd68ce tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:13.305924 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b3eb6845-f5d0-4c3a-88f3-d3ffb4bd68ce tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:13.308709 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:13.309509 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=8 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:13.317036 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b3eb6845-f5d0-4c3a-88f3-d3ffb4bd68ce tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:13.317494 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b3eb6845-f5d0-4c3a-88f3-d3ffb4bd68ce tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:13.317930 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b3eb6845-f5d0-4c3a-88f3-d3ffb4bd68ce tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:13.318640 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b3eb6845-f5d0-4c3a-88f3-d3ffb4bd68ce tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:13.319096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b3eb6845-f5d0-4c3a-88f3-d3ffb4bd68ce tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:13.319523 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b3eb6845-f5d0-4c3a-88f3-d3ffb4bd68ce tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:13.504898 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b3eb6845-f5d0-4c3a-88f3-d3ffb4bd68ce tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:13.514311 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b3eb6845-f5d0-4c3a-88f3-d3ffb4bd68ce tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 200 len: 1507 microversion: 2.1 time: 0.212928 Aug 29 20:42:13.514974 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 500/979] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:13 2022] GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:13.541803 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d9643311-f940-418f-a5fa-ce03f5ef04be tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae11e6db-6db8-4127-ad8c-2bde8d8822e9", "device": "/dev/sdb"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:42:13.545394 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d9643311-f940-418f-a5fa-ce03f5ef04be tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:13.555240 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9643311-f940-418f-a5fa-ce03f5ef04be tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:13.555773 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9643311-f940-418f-a5fa-ce03f5ef04be tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:13.556244 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9643311-f940-418f-a5fa-ce03f5ef04be tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:13.556955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9643311-f940-418f-a5fa-ce03f5ef04be tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:13.557408 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9643311-f940-418f-a5fa-ce03f5ef04be tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:13.557826 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d9643311-f940-418f-a5fa-ce03f5ef04be tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:13.901698 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d9643311-f940-418f-a5fa-ce03f5ef04be tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "POST /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365312 Aug 29 20:42:13.902740 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 480/980] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 29 20:42:13 2022] POST /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:42:33.520752 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9700f6f9-b331-47fb-af02-4bf86baea58f tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:33.521286 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9700f6f9-b331-47fb-af02-4bf86baea58f tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:33.523149 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:33.524137 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=64 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:33.530274 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9700f6f9-b331-47fb-af02-4bf86baea58f tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:33.530757 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9700f6f9-b331-47fb-af02-4bf86baea58f tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:33.531189 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9700f6f9-b331-47fb-af02-4bf86baea58f tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:33.531881 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9700f6f9-b331-47fb-af02-4bf86baea58f tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:33.532369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9700f6f9-b331-47fb-af02-4bf86baea58f tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:33.532788 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9700f6f9-b331-47fb-af02-4bf86baea58f tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:33.612206 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-9700f6f9-b331-47fb-af02-4bf86baea58f tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lazy-loading 'services' on Instance uuid ec60590b-210b-4d80-af3a-265de343cca0 {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:42:33.685313 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9700f6f9-b331-47fb-af02-4bf86baea58f tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0/os-volume_attachments/ae11e6db-6db8-4127-ad8c-2bde8d8822e9" status: 202 len: 0 microversion: 2.1 time: 0.168483 Aug 29 20:42:33.685966 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 501/981] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 29 20:42:33 2022] DELETE /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0/os-volume_attachments/ae11e6db-6db8-4127-ad8c-2bde8d8822e9 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:42:34.803774 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:34.804578 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:34.808893 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-aa97d9fe-d53f-45d2-a666-e0de9f35fd84 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:34.809469 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aa97d9fe-d53f-45d2-a666-e0de9f35fd84 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:34.816988 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa97d9fe-d53f-45d2-a666-e0de9f35fd84 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:34.817469 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa97d9fe-d53f-45d2-a666-e0de9f35fd84 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:34.817904 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa97d9fe-d53f-45d2-a666-e0de9f35fd84 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:34.818594 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa97d9fe-d53f-45d2-a666-e0de9f35fd84 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:34.819046 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa97d9fe-d53f-45d2-a666-e0de9f35fd84 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:34.819471 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-aa97d9fe-d53f-45d2-a666-e0de9f35fd84 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:34.845489 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-aa97d9fe-d53f-45d2-a666-e0de9f35fd84 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:42:34.921275 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-aa97d9fe-d53f-45d2-a666-e0de9f35fd84 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 204 len: 0 microversion: 2.1 time: 0.118776 Aug 29 20:42:34.921845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 481/982] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:42:34 2022] DELETE /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 20:42:34.931054 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-20faf7e1-1208-4885-ab06-a5b9793d12b7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:34.931854 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-20faf7e1-1208-4885-ab06-a5b9793d12b7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:34.938089 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-20faf7e1-1208-4885-ab06-a5b9793d12b7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:34.938571 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-20faf7e1-1208-4885-ab06-a5b9793d12b7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:34.939022 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-20faf7e1-1208-4885-ab06-a5b9793d12b7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:34.940026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-20faf7e1-1208-4885-ab06-a5b9793d12b7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:34.940487 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-20faf7e1-1208-4885-ab06-a5b9793d12b7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:34.940915 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-20faf7e1-1208-4885-ab06-a5b9793d12b7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:35.069852 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-20faf7e1-1208-4885-ab06-a5b9793d12b7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:35.077548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-20faf7e1-1208-4885-ab06-a5b9793d12b7 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 200 len: 1513 microversion: 2.1 time: 0.151249 Aug 29 20:42:35.078117 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 502/983] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:34 2022] GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:36.100609 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-38dc1ab2-9308-4d8a-80a5-913ce37c6129 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:36.101306 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-38dc1ab2-9308-4d8a-80a5-913ce37c6129 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:36.107704 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38dc1ab2-9308-4d8a-80a5-913ce37c6129 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:36.108211 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38dc1ab2-9308-4d8a-80a5-913ce37c6129 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:36.108641 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38dc1ab2-9308-4d8a-80a5-913ce37c6129 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:36.109321 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38dc1ab2-9308-4d8a-80a5-913ce37c6129 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:36.109767 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38dc1ab2-9308-4d8a-80a5-913ce37c6129 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:36.110182 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-38dc1ab2-9308-4d8a-80a5-913ce37c6129 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:36.239227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-38dc1ab2-9308-4d8a-80a5-913ce37c6129 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:36.246859 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-38dc1ab2-9308-4d8a-80a5-913ce37c6129 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 200 len: 1513 microversion: 2.1 time: 0.150745 Aug 29 20:42:36.247419 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 482/984] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:36 2022] GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:42:37.267846 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-1cbd4729-281e-43bf-a08e-244ff375aca3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:37.268488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-1cbd4729-281e-43bf-a08e-244ff375aca3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:37.275041 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1cbd4729-281e-43bf-a08e-244ff375aca3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:37.275525 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1cbd4729-281e-43bf-a08e-244ff375aca3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:37.275975 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1cbd4729-281e-43bf-a08e-244ff375aca3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:37.277020 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1cbd4729-281e-43bf-a08e-244ff375aca3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:37.277271 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1cbd4729-281e-43bf-a08e-244ff375aca3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:37.277724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-1cbd4729-281e-43bf-a08e-244ff375aca3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:37.416973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-1cbd4729-281e-43bf-a08e-244ff375aca3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037a2fa230a840cbaf876540632aeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '732a8a55dfbd44afa826eb6f5571aabf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:42:37.425725 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-1cbd4729-281e-43bf-a08e-244ff375aca3 tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 200 len: 1513 microversion: 2.1 time: 0.161737 Aug 29 20:42:37.426302 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 503/985] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:37 2022] GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:42:37.617310 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-4ca2ba94-9d4b-4220-88b5-7c4bbbd85cdf req-ff74da66-12cb-43cd-97fe-773ef00f112d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec60590b-210b-4d80-af3a-265de343cca0", "name": "network-vif-deleted", "tag": "e14210f8-332e-4ea4-9e9b-6eca4b2c8f25"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:42:37.628110 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4ca2ba94-9d4b-4220-88b5-7c4bbbd85cdf req-ff74da66-12cb-43cd-97fe-773ef00f112d service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:37.628590 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4ca2ba94-9d4b-4220-88b5-7c4bbbd85cdf req-ff74da66-12cb-43cd-97fe-773ef00f112d service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:37.629023 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-4ca2ba94-9d4b-4220-88b5-7c4bbbd85cdf req-ff74da66-12cb-43cd-97fe-773ef00f112d service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:37.640779 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-4ca2ba94-9d4b-4220-88b5-7c4bbbd85cdf req-ff74da66-12cb-43cd-97fe-773ef00f112d service nova] Creating event network-vif-deleted:e14210f8-332e-4ea4-9e9b-6eca4b2c8f25 for instance ec60590b-210b-4d80-af3a-265de343cca0 on hv-cinder-85426 Aug 29 20:42:37.645431 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-4ca2ba94-9d4b-4220-88b5-7c4bbbd85cdf req-ff74da66-12cb-43cd-97fe-773ef00f112d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031742 Aug 29 20:42:37.646000 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 483/986] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:42:38.446986 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-335a7b0c-4c0d-4807-aa4d-7a6ab3252cec tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:38.447833 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-335a7b0c-4c0d-4807-aa4d-7a6ab3252cec tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] [instance: ec60590b-210b-4d80-af3a-265de343cca0] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:38.455786 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-335a7b0c-4c0d-4807-aa4d-7a6ab3252cec tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:38.456306 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-335a7b0c-4c0d-4807-aa4d-7a6ab3252cec tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:38.456738 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-335a7b0c-4c0d-4807-aa4d-7a6ab3252cec tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:38.457434 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-335a7b0c-4c0d-4807-aa4d-7a6ab3252cec tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:38.457920 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-335a7b0c-4c0d-4807-aa4d-7a6ab3252cec tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:38.458417 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-335a7b0c-4c0d-4807-aa4d-7a6ab3252cec tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:38.473952 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-335a7b0c-4c0d-4807-aa4d-7a6ab3252cec tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] HTTP exception thrown: Instance ec60590b-210b-4d80-af3a-265de343cca0 could not be found. Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-335a7b0c-4c0d-4807-aa4d-7a6ab3252cec tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Request method failure captured: Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 HTTP/1.1 Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSRO2eEq_i5KBuuISzh6C58bnFfj-3cHKDXQqgo_buIa2l69PEDIn7XmdHFocBWr1qel2sCCGHdPV75W-Tgg87yh8719P58EAcjvNmM5f2Rjz8UZv91qrgKqZhchNk2hk0vW-Pa_YVV2txnlyexWG3eRB3jYu48wklSwSdQPHpNo8e0 Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 732a8a55dfbd44afa826eb6f5571aabf Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1254344129 Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:42:38.475609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:42:38.477387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/732a8a55dfbd44afa826eb6f5571aabf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/732a8a55dfbd44afa826eb6f5571aabf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/732a8a55dfbd44afa826eb6f5571aabf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_732a8a55dfbd44afa826eb6f5571aabf"}]}] Aug 29 20:42:38.477387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-VolumesSnapshotTestJSON-1254344129 Aug 29 20:42:38.477387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 732a8a55dfbd44afa826eb6f5571aabf Aug 29 20:42:38.477387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1254344129 Aug 29 20:42:38.477387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-VolumesSnapshotTestJSON-1254344129-project Aug 29 20:42:38.477387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:42:38.477387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:42:38.477387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 037a2fa230a840cbaf876540632aeafa Aug 29 20:42:38.477387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-VolumesSnapshotTestJSON-1254344129-project Aug 29 20:42:38.477387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:42:38.477387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance ec60590b-210b-4d80-af3a-265de343cca0 could not be found. Aug 29 20:42:38.477387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': 'ec60590b-210b-4d80-af3a-265de343cca0'} Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec60590b-210b-4d80-af3a-265de343cca0 could not be found. Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:42:38.478380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec60590b-210b-4d80-af3a-265de343cca0 could not be found. Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec60590b-210b-4d80-af3a-265de343cca0 could not be found. Aug 29 20:42:38.479724 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:42:38.480939 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-335a7b0c-4c0d-4807-aa4d-7a6ab3252cec tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] Returning 404 to user: Instance ec60590b-210b-4d80-af3a-265de343cca0 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:42:38.480939 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-335a7b0c-4c0d-4807-aa4d-7a6ab3252cec tempest-VolumesSnapshotTestJSON-1254344129 tempest-VolumesSnapshotTestJSON-1254344129-project] 10.222.0.18 "GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0" status: 404 len: 111 microversion: 2.1 time: 0.034212 Aug 29 20:42:38.480939 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 504/987] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:42:38 2022] GET /compute/v2.1/servers/ec60590b-210b-4d80-af3a-265de343cca0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:42:46.796235 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8112f1c6-2f19-4d1b-a155-1c9ba15283de tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:42:46.797019 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8112f1c6-2f19-4d1b-a155-1c9ba15283de tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:46.803600 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8112f1c6-2f19-4d1b-a155-1c9ba15283de tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:46.804119 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8112f1c6-2f19-4d1b-a155-1c9ba15283de tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:46.804600 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8112f1c6-2f19-4d1b-a155-1c9ba15283de tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:46.805236 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8112f1c6-2f19-4d1b-a155-1c9ba15283de tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:46.805688 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8112f1c6-2f19-4d1b-a155-1c9ba15283de tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:46.806113 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8112f1c6-2f19-4d1b-a155-1c9ba15283de tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:46.830596 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8112f1c6-2f19-4d1b-a155-1c9ba15283de tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248/ips" status: 200 len: 149 microversion: 2.1 time: 0.040361 Aug 29 20:42:46.831347 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 484/988] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 29 20:42:46 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:42:48.206574 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2bc10d11-4f8f-438f-a1c3-2e3903a52089 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b552c6f6-bd24-40e2-973f-2251eb8e7d41"}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:42:48.209070 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2bc10d11-4f8f-438f-a1c3-2e3903a52089 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:42:48.215739 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2bc10d11-4f8f-438f-a1c3-2e3903a52089 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:48.216265 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2bc10d11-4f8f-438f-a1c3-2e3903a52089 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:48.216702 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2bc10d11-4f8f-438f-a1c3-2e3903a52089 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:48.217465 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2bc10d11-4f8f-438f-a1c3-2e3903a52089 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:42:48.217923 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2bc10d11-4f8f-438f-a1c3-2e3903a52089 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:42:48.218350 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2bc10d11-4f8f-438f-a1c3-2e3903a52089 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:42:48.476431 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2bc10d11-4f8f-438f-a1c3-2e3903a52089 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "POST /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273587 Aug 29 20:42:48.477302 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 505/989] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 29 20:42:48 2022] POST /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:42:59.165837 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4bd9d98d-ebb0-4bc9-a8b8-eece16aeaa73 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Action: 'create', calling method: .version_select at 0x7f486310cdc0>, body: {"keypair": {"name": "tempest-keypair-275740109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8ELE4/r7fgP+W7GW/6hdPPARfuB11nAK66r9Zr12I/3mQqTIYSvKvTpQq/8/3o5FPUezBPs0WpCqv0pXzahy666mJJB9DLmVn1zgvLtX9AKGMBHJAGTaTOSKu2pQk8bg=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:42:59.172165 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:59.172972 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:59.186446 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-4bd9d98d-ebb0-4bc9-a8b8-eece16aeaa73 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for project 076e4d9f49a944c487077e845726ad82. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:42:59.191014 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-4bd9d98d-ebb0-4bc9-a8b8-eece16aeaa73 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for user 70aaca5187e54f25ad94d9515278e039 and project 076e4d9f49a944c487077e845726ad82. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:42:59.212282 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4bd9d98d-ebb0-4bc9-a8b8-eece16aeaa73 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050373 Aug 29 20:42:59.212869 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 485/990] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 29 20:42:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:43:00.475699 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=10 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:00.476517 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:00.481899 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-648858109", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "931f5e99-b53b-4e33-bc47-b08971122f04"}], "security_groups": [{"name": "tempest-securitygroup--611019595"}], "key_name": "tempest-keypair-275740109", "user_data": "}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:43:00.695602 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.network.neutron [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] validate_networks() for [('931f5e99-b53b-4e33-bc47-b08971122f04', None, None, None, None, None)] {{(pid=127027) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:43:01.072959 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Flavor limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:43:01.073383 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Image limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:43:01.073858 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Flavor pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:43:01.074270 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Image pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:43:01.074738 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:43:01.083463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:01.083976 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:01.084405 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:01.085136 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:01.085591 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:01.086016 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:01.103114 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for project 076e4d9f49a944c487077e845726ad82. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:43:01.107703 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for user 70aaca5187e54f25ad94d9515278e039 and project 076e4d9f49a944c487077e845726ad82. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:43:01.118861 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Going to run 1 instances... {{(pid=127027) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:43:01.121278 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:43:01.168518 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-cb230fca-41ae-4c29-bdfc-a62c63d07d28 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.694189 Aug 29 20:43:01.169161 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 506/991] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:43:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:43:01.180528 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-dddf24e4-1020-41e8-b47c-7e67618b45f7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:01.181344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-dddf24e4-1020-41e8-b47c-7e67618b45f7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:01.288962 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-dddf24e4-1020-41e8-b47c-7e67618b45f7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:01.296657 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-dddf24e4-1020-41e8-b47c-7e67618b45f7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 200 len: 1240 microversion: 2.1 time: 0.120524 Aug 29 20:43:01.297225 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 486/992] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:01 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 1240 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:02.317617 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-04bfa17b-5e91-4b34-a797-fd4603a73a38 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:02.319742 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-04bfa17b-5e91-4b34-a797-fd4603a73a38 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:02.332007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-04bfa17b-5e91-4b34-a797-fd4603a73a38 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:02.333152 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-04bfa17b-5e91-4b34-a797-fd4603a73a38 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:02.334081 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-04bfa17b-5e91-4b34-a797-fd4603a73a38 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:02.335239 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-04bfa17b-5e91-4b34-a797-fd4603a73a38 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:02.335919 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-04bfa17b-5e91-4b34-a797-fd4603a73a38 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:02.337211 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-04bfa17b-5e91-4b34-a797-fd4603a73a38 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:02.439798 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-04bfa17b-5e91-4b34-a797-fd4603a73a38 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:02.452756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-04bfa17b-5e91-4b34-a797-fd4603a73a38 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 200 len: 1300 microversion: 2.1 time: 0.139125 Aug 29 20:43:02.453392 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 507/993] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:02 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:03.474399 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fd6e9ce1-fe73-426e-a1b8-fb76f836d9dd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:03.475755 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fd6e9ce1-fe73-426e-a1b8-fb76f836d9dd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:03.483741 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd6e9ce1-fe73-426e-a1b8-fb76f836d9dd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:03.484345 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd6e9ce1-fe73-426e-a1b8-fb76f836d9dd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:03.484776 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd6e9ce1-fe73-426e-a1b8-fb76f836d9dd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:03.485554 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd6e9ce1-fe73-426e-a1b8-fb76f836d9dd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:03.486021 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd6e9ce1-fe73-426e-a1b8-fb76f836d9dd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:03.486441 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd6e9ce1-fe73-426e-a1b8-fb76f836d9dd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:03.678380 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd6e9ce1-fe73-426e-a1b8-fb76f836d9dd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:03.687992 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fd6e9ce1-fe73-426e-a1b8-fb76f836d9dd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 200 len: 1365 microversion: 2.1 time: 0.217664 Aug 29 20:43:03.688581 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 487/994] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:03 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:04.190818 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-d70b509f-9266-472b-8481-3b777c8e15fb req-09e1eed7-f4d3-480e-8b5e-c386f0167fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "537b47db-7d5d-4bb8-8b81-b63759ecc7b8", "tag": "bcc8e3d8-82ec-4b82-8e13-69385ff280e0"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:43:04.205182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-d70b509f-9266-472b-8481-3b777c8e15fb req-09e1eed7-f4d3-480e-8b5e-c386f0167fad service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:04.205586 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-d70b509f-9266-472b-8481-3b777c8e15fb req-09e1eed7-f4d3-480e-8b5e-c386f0167fad service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:04.206011 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-d70b509f-9266-472b-8481-3b777c8e15fb req-09e1eed7-f4d3-480e-8b5e-c386f0167fad service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:04.219288 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-d70b509f-9266-472b-8481-3b777c8e15fb req-09e1eed7-f4d3-480e-8b5e-c386f0167fad service nova] Creating event network-changed:bcc8e3d8-82ec-4b82-8e13-69385ff280e0 for instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 on hv-cinder-85426 Aug 29 20:43:04.224568 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-d70b509f-9266-472b-8481-3b777c8e15fb req-09e1eed7-f4d3-480e-8b5e-c386f0167fad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038180 Aug 29 20:43:04.225176 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 508/995] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:43:04.709762 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6a326c1e-50e6-4941-a3e6-61f04085be89 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:04.710374 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6a326c1e-50e6-4941-a3e6-61f04085be89 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:04.716863 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a326c1e-50e6-4941-a3e6-61f04085be89 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:04.717344 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a326c1e-50e6-4941-a3e6-61f04085be89 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:04.717815 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a326c1e-50e6-4941-a3e6-61f04085be89 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:04.718509 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a326c1e-50e6-4941-a3e6-61f04085be89 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:04.718961 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a326c1e-50e6-4941-a3e6-61f04085be89 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:04.719383 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6a326c1e-50e6-4941-a3e6-61f04085be89 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:04.848034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6a326c1e-50e6-4941-a3e6-61f04085be89 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:04.855643 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6a326c1e-50e6-4941-a3e6-61f04085be89 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 200 len: 1365 microversion: 2.1 time: 0.149774 Aug 29 20:43:04.856777 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 488/996] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:04 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:05.878120 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-385b5ad7-25de-4ce6-b1f4-4502b0232cce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:05.878824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-385b5ad7-25de-4ce6-b1f4-4502b0232cce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:05.885623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-385b5ad7-25de-4ce6-b1f4-4502b0232cce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:05.886113 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-385b5ad7-25de-4ce6-b1f4-4502b0232cce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:05.886554 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-385b5ad7-25de-4ce6-b1f4-4502b0232cce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:05.887910 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-385b5ad7-25de-4ce6-b1f4-4502b0232cce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:05.889098 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-385b5ad7-25de-4ce6-b1f4-4502b0232cce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:05.889098 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-385b5ad7-25de-4ce6-b1f4-4502b0232cce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:06.106936 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-385b5ad7-25de-4ce6-b1f4-4502b0232cce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:06.114493 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-385b5ad7-25de-4ce6-b1f4-4502b0232cce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 200 len: 1365 microversion: 2.1 time: 0.240682 Aug 29 20:43:06.115061 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 509/997] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:05 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:07.135248 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-131806ae-61fa-42c1-936b-76edbb030b7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:07.135865 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-131806ae-61fa-42c1-936b-76edbb030b7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:07.142388 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-131806ae-61fa-42c1-936b-76edbb030b7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:07.142869 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-131806ae-61fa-42c1-936b-76edbb030b7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:07.143303 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-131806ae-61fa-42c1-936b-76edbb030b7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:07.144022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-131806ae-61fa-42c1-936b-76edbb030b7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:07.144474 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-131806ae-61fa-42c1-936b-76edbb030b7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:07.144899 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-131806ae-61fa-42c1-936b-76edbb030b7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:07.274932 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-131806ae-61fa-42c1-936b-76edbb030b7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:07.283038 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-131806ae-61fa-42c1-936b-76edbb030b7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 200 len: 1365 microversion: 2.1 time: 0.151706 Aug 29 20:43:07.283602 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 489/998] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:07 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:08.304893 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-39998aa1-77fb-4ece-a24c-45f00096f124 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:08.305513 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-39998aa1-77fb-4ece-a24c-45f00096f124 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:08.312304 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-39998aa1-77fb-4ece-a24c-45f00096f124 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:08.312793 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-39998aa1-77fb-4ece-a24c-45f00096f124 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:08.313231 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-39998aa1-77fb-4ece-a24c-45f00096f124 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:08.313931 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-39998aa1-77fb-4ece-a24c-45f00096f124 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:08.314387 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-39998aa1-77fb-4ece-a24c-45f00096f124 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:08.314811 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-39998aa1-77fb-4ece-a24c-45f00096f124 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:08.446515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-39998aa1-77fb-4ece-a24c-45f00096f124 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:08.455595 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-39998aa1-77fb-4ece-a24c-45f00096f124 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 200 len: 1365 microversion: 2.1 time: 0.154549 Aug 29 20:43:08.456418 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 510/999] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:08 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:09.477725 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6c620e13-0483-4ba0-aba5-b9cb1bac0071 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:09.478269 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6c620e13-0483-4ba0-aba5-b9cb1bac0071 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:09.485361 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c620e13-0483-4ba0-aba5-b9cb1bac0071 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:09.485660 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c620e13-0483-4ba0-aba5-b9cb1bac0071 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:09.486036 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c620e13-0483-4ba0-aba5-b9cb1bac0071 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:09.486717 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c620e13-0483-4ba0-aba5-b9cb1bac0071 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:09.487157 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c620e13-0483-4ba0-aba5-b9cb1bac0071 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:09.487565 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6c620e13-0483-4ba0-aba5-b9cb1bac0071 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:09.533510 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-83deccca-07be-47bb-828e-fdc6d3cb77db req-14d426a7-1662-40d1-93ea-d9c2852aa044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "537b47db-7d5d-4bb8-8b81-b63759ecc7b8", "name": "network-vif-plugged", "status": "completed", "tag": "bcc8e3d8-82ec-4b82-8e13-69385ff280e0"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:43:09.546138 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-83deccca-07be-47bb-828e-fdc6d3cb77db req-14d426a7-1662-40d1-93ea-d9c2852aa044 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:09.546830 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-83deccca-07be-47bb-828e-fdc6d3cb77db req-14d426a7-1662-40d1-93ea-d9c2852aa044 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:09.547394 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-83deccca-07be-47bb-828e-fdc6d3cb77db req-14d426a7-1662-40d1-93ea-d9c2852aa044 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:09.560527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-83deccca-07be-47bb-828e-fdc6d3cb77db req-14d426a7-1662-40d1-93ea-d9c2852aa044 service nova] Creating event network-vif-plugged:bcc8e3d8-82ec-4b82-8e13-69385ff280e0 for instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 on hv-cinder-85426 Aug 29 20:43:09.565847 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-83deccca-07be-47bb-828e-fdc6d3cb77db req-14d426a7-1662-40d1-93ea-d9c2852aa044 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035769 Aug 29 20:43:09.566452 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 511/1000] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:43:09.639514 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6c620e13-0483-4ba0-aba5-b9cb1bac0071 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:09.650002 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6c620e13-0483-4ba0-aba5-b9cb1bac0071 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 200 len: 1365 microversion: 2.1 time: 0.175737 Aug 29 20:43:09.650952 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 490/1001] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:09 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:10.673561 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-920e3690-977b-4bbd-91e6-3e402352f204 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:10.674216 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-920e3690-977b-4bbd-91e6-3e402352f204 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:10.680869 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-920e3690-977b-4bbd-91e6-3e402352f204 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:10.681345 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-920e3690-977b-4bbd-91e6-3e402352f204 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:10.681801 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-920e3690-977b-4bbd-91e6-3e402352f204 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:10.682488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-920e3690-977b-4bbd-91e6-3e402352f204 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:10.682939 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-920e3690-977b-4bbd-91e6-3e402352f204 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:10.683361 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-920e3690-977b-4bbd-91e6-3e402352f204 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:10.821885 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-920e3690-977b-4bbd-91e6-3e402352f204 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:10.830218 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-920e3690-977b-4bbd-91e6-3e402352f204 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 200 len: 1365 microversion: 2.1 time: 0.160950 Aug 29 20:43:10.830792 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 512/1002] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:10 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:11.851224 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-90f14681-aa95-4611-b2f3-332479e16c08 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:11.851833 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-90f14681-aa95-4611-b2f3-332479e16c08 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:11.854551 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:11.860641 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90f14681-aa95-4611-b2f3-332479e16c08 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:11.861118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90f14681-aa95-4611-b2f3-332479e16c08 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:11.861550 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90f14681-aa95-4611-b2f3-332479e16c08 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:11.862245 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90f14681-aa95-4611-b2f3-332479e16c08 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:11.862697 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90f14681-aa95-4611-b2f3-332479e16c08 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:11.863115 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-90f14681-aa95-4611-b2f3-332479e16c08 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:12.137815 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-90f14681-aa95-4611-b2f3-332479e16c08 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:12.145449 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-90f14681-aa95-4611-b2f3-332479e16c08 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 200 len: 1554 microversion: 2.1 time: 0.298188 Aug 29 20:43:12.146011 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 491/1003] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:11 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 1554 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:12.165417 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7d6d9258-de63-4ec9-bb37-01f40c33e95c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:12.165967 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7d6d9258-de63-4ec9-bb37-01f40c33e95c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:12.167884 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:12.169079 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=6 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:12.175598 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d6d9258-de63-4ec9-bb37-01f40c33e95c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:12.176115 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d6d9258-de63-4ec9-bb37-01f40c33e95c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:12.176557 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d6d9258-de63-4ec9-bb37-01f40c33e95c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:12.177267 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d6d9258-de63-4ec9-bb37-01f40c33e95c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:12.177725 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d6d9258-de63-4ec9-bb37-01f40c33e95c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:12.178156 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7d6d9258-de63-4ec9-bb37-01f40c33e95c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:12.256343 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7d6d9258-de63-4ec9-bb37-01f40c33e95c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094853 Aug 29 20:43:12.256934 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 513/1004] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 29 20:43:12 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:43:13.188248 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-15e9277a-0517-42dd-bb7d-43da1740fcbd req-3dae7d25-a9fd-454e-bca8-c49ebd326313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "537b47db-7d5d-4bb8-8b81-b63759ecc7b8", "tag": "bcc8e3d8-82ec-4b82-8e13-69385ff280e0"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:43:13.198247 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-15e9277a-0517-42dd-bb7d-43da1740fcbd req-3dae7d25-a9fd-454e-bca8-c49ebd326313 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:13.198731 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-15e9277a-0517-42dd-bb7d-43da1740fcbd req-3dae7d25-a9fd-454e-bca8-c49ebd326313 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:13.199161 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-15e9277a-0517-42dd-bb7d-43da1740fcbd req-3dae7d25-a9fd-454e-bca8-c49ebd326313 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:13.210835 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-15e9277a-0517-42dd-bb7d-43da1740fcbd req-3dae7d25-a9fd-454e-bca8-c49ebd326313 service nova] Creating event network-changed:bcc8e3d8-82ec-4b82-8e13-69385ff280e0 for instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 on hv-cinder-85426 Aug 29 20:43:13.216038 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-15e9277a-0517-42dd-bb7d-43da1740fcbd req-3dae7d25-a9fd-454e-bca8-c49ebd326313 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031847 Aug 29 20:43:13.216654 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 492/1005] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:43:57.180817 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:57.181663 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=34 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:57.186058 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8188c0d9-4574-47fb-a4eb-48318574336f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:57.186546 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8188c0d9-4574-47fb-a4eb-48318574336f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:57.194569 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8188c0d9-4574-47fb-a4eb-48318574336f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:57.195080 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8188c0d9-4574-47fb-a4eb-48318574336f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:57.195510 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8188c0d9-4574-47fb-a4eb-48318574336f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:57.196240 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8188c0d9-4574-47fb-a4eb-48318574336f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:57.196687 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8188c0d9-4574-47fb-a4eb-48318574336f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:57.197112 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8188c0d9-4574-47fb-a4eb-48318574336f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:57.229518 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8188c0d9-4574-47fb-a4eb-48318574336f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8/ips" status: 200 len: 147 microversion: 2.1 time: 0.049624 Aug 29 20:43:57.233268 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 514/1006] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 29 20:43:57 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8/ips => generated 147 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:43:57.242603 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:57.243359 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=32 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:57.248364 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d29c4724-4442-477e-853c-d72e1c6c276f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b552c6f6-bd24-40e2-973f-2251eb8e7d41"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:43:57.250733 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d29c4724-4442-477e-853c-d72e1c6c276f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:57.258495 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d29c4724-4442-477e-853c-d72e1c6c276f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:57.259254 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d29c4724-4442-477e-853c-d72e1c6c276f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:57.259860 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d29c4724-4442-477e-853c-d72e1c6c276f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:57.260607 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d29c4724-4442-477e-853c-d72e1c6c276f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:57.261062 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d29c4724-4442-477e-853c-d72e1c6c276f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:57.261490 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d29c4724-4442-477e-853c-d72e1c6c276f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:57.358951 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-d29c4724-4442-477e-853c-d72e1c6c276f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] HTTP exception thrown: Invalid volume: volume b552c6f6-bd24-40e2-973f-2251eb8e7d41 is already attached to instances: 2ea03034-17ef-42a5-af06-60d8e43be248 Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d29c4724-4442-477e-853c-d72e1c6c276f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Request method failure captured: Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: POST /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8/os-volume_attachments HTTP/1.1 Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 74 Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSSDqC88R7K8cLVWjZy4WK9zDiB6pwu9x2QyB2x9zAV7V1y0va6W2DKi7FyWua95fjBbT8Eyql-6591277ISk8v9v3fQo4yBhJRoK93DHfRmOWK_exB1IlX87Hj7Ic02JfSlZ4LRSLZeEIXK59FTaLzb4HU_ETTTTFo1lBGf3CBby0A Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:43:57.360694 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:43:57.362858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/076e4d9f49a944c487077e845726ad82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_076e4d9f49a944c487077e845726ad82"}]}] Aug 29 20:43:57.362858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:43:57.362858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:43:57.362858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:43:57.362858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:43:57.362858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:43:57.362858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:43:57.362858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 70aaca5187e54f25ad94d9515278e039 Aug 29 20:43:57.362858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:43:57.362858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Aug 29 20:43:57.362858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {"volumeAttachment": {"volumeId": "b552c6f6-bd24-40e2-973f-2251eb8e7d41"}} Aug 29 20:43:57.362858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Invalid volume: volume b552c6f6-bd24-40e2-973f-2251eb8e7d41 is already attached to instances: 2ea03034-17ef-42a5-af06-60d8e43be248 Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'server_id': '537b47db-7d5d-4bb8-8b81-b63759ecc7b8', 'body': {'volumeAttachment': {'volumeId': 'b552c6f6-bd24-40e2-973f-2251eb8e7d41'}}} Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b552c6f6-bd24-40e2-973f-2251eb8e7d41 is already attached to instances: 2ea03034-17ef-42a5-af06-60d8e43be248 Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:43:57.364382 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b552c6f6-bd24-40e2-973f-2251eb8e7d41 is already attached to instances: 2ea03034-17ef-42a5-af06-60d8e43be248 Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:43:57.366102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:43:57.368298 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:43:57.368298 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:43:57.368298 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:43:57.368298 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b552c6f6-bd24-40e2-973f-2251eb8e7d41 is already attached to instances: 2ea03034-17ef-42a5-af06-60d8e43be248 Aug 29 20:43:57.368298 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:43:57.368298 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d29c4724-4442-477e-853c-d72e1c6c276f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Returning 400 to user: Invalid volume: volume b552c6f6-bd24-40e2-973f-2251eb8e7d41 is already attached to instances: 2ea03034-17ef-42a5-af06-60d8e43be248 {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:43:57.368298 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d29c4724-4442-477e-853c-d72e1c6c276f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "POST /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121328 Aug 29 20:43:57.368298 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 493/1007] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 29 20:43:57 2022] POST /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 20:43:57.371714 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6c1c807f-510a-4c5c-b919-228811f23781 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:57.372279 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6c1c807f-510a-4c5c-b919-228811f23781 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:57.380607 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c1c807f-510a-4c5c-b919-228811f23781 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:57.381088 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c1c807f-510a-4c5c-b919-228811f23781 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:57.381526 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c1c807f-510a-4c5c-b919-228811f23781 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:57.382365 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c1c807f-510a-4c5c-b919-228811f23781 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:57.383119 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c1c807f-510a-4c5c-b919-228811f23781 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:57.383287 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6c1c807f-510a-4c5c-b919-228811f23781 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:57.422246 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6c1c807f-510a-4c5c-b919-228811f23781 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Going to try to terminate instance {{(pid=127027) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:43:57.506586 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6c1c807f-510a-4c5c-b919-228811f23781 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 204 len: 0 microversion: 2.1 time: 0.138444 Aug 29 20:43:57.507646 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 515/1008] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:43:57 2022] DELETE /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:43:57.515775 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-bf288fdf-7e95-403e-899e-b08db3cd139c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:57.516693 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-bf288fdf-7e95-403e-899e-b08db3cd139c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:57.523721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf288fdf-7e95-403e-899e-b08db3cd139c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:57.524250 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf288fdf-7e95-403e-899e-b08db3cd139c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:57.524681 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf288fdf-7e95-403e-899e-b08db3cd139c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:57.525373 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf288fdf-7e95-403e-899e-b08db3cd139c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:57.525824 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf288fdf-7e95-403e-899e-b08db3cd139c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:57.526245 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-bf288fdf-7e95-403e-899e-b08db3cd139c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:57.665760 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-bf288fdf-7e95-403e-899e-b08db3cd139c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:57.673481 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-bf288fdf-7e95-403e-899e-b08db3cd139c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 200 len: 1677 microversion: 2.1 time: 0.161549 Aug 29 20:43:57.674028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 494/1009] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:57 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:58.696753 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-659da8d3-d143-4705-a43c-c754bda28e26 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:58.697448 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-659da8d3-d143-4705-a43c-c754bda28e26 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:58.703898 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-659da8d3-d143-4705-a43c-c754bda28e26 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:58.704331 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-659da8d3-d143-4705-a43c-c754bda28e26 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:58.704761 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-659da8d3-d143-4705-a43c-c754bda28e26 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:58.705440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-659da8d3-d143-4705-a43c-c754bda28e26 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:58.705887 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-659da8d3-d143-4705-a43c-c754bda28e26 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:58.706301 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-659da8d3-d143-4705-a43c-c754bda28e26 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:58.842190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-659da8d3-d143-4705-a43c-c754bda28e26 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:58.849921 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-659da8d3-d143-4705-a43c-c754bda28e26 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 200 len: 1677 microversion: 2.1 time: 0.158425 Aug 29 20:43:58.850477 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 516/1010] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:58 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:43:59.871657 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b19121d7-f1b4-4a60-8fce-533219add4bd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:43:59.872233 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b19121d7-f1b4-4a60-8fce-533219add4bd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:43:59.878586 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b19121d7-f1b4-4a60-8fce-533219add4bd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:59.879055 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b19121d7-f1b4-4a60-8fce-533219add4bd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:59.879482 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b19121d7-f1b4-4a60-8fce-533219add4bd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:59.880190 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b19121d7-f1b4-4a60-8fce-533219add4bd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:43:59.880633 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b19121d7-f1b4-4a60-8fce-533219add4bd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:43:59.881043 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b19121d7-f1b4-4a60-8fce-533219add4bd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:43:59.945627 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-b19121d7-f1b4-4a60-8fce-533219add4bd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:43:59.953783 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b19121d7-f1b4-4a60-8fce-533219add4bd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 200 len: 1610 microversion: 2.1 time: 0.086031 Aug 29 20:43:59.954699 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 495/1011] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:43:59 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 1610 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:00.526596 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-c190e6eb-23e5-4539-985c-53b6393ca058 req-cdef6832-d8f4-4e36-8709-c8a39511e5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "537b47db-7d5d-4bb8-8b81-b63759ecc7b8", "name": "network-vif-deleted", "tag": "bcc8e3d8-82ec-4b82-8e13-69385ff280e0"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:44:00.539978 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-c190e6eb-23e5-4539-985c-53b6393ca058 req-cdef6832-d8f4-4e36-8709-c8a39511e5e7 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:00.545591 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-c190e6eb-23e5-4539-985c-53b6393ca058 req-cdef6832-d8f4-4e36-8709-c8a39511e5e7 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:00.546034 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-c190e6eb-23e5-4539-985c-53b6393ca058 req-cdef6832-d8f4-4e36-8709-c8a39511e5e7 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:00.562283 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-c190e6eb-23e5-4539-985c-53b6393ca058 req-cdef6832-d8f4-4e36-8709-c8a39511e5e7 service nova] Creating event network-vif-deleted:bcc8e3d8-82ec-4b82-8e13-69385ff280e0 for instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 on hv-cinder-85426 Aug 29 20:44:00.568183 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-c190e6eb-23e5-4539-985c-53b6393ca058 req-cdef6832-d8f4-4e36-8709-c8a39511e5e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323801 Aug 29 20:44:00.568979 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 517/1012] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:44:00.977620 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7d5f5bc8-665e-48f2-b26e-6a7d08f14313 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:00.979222 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7d5f5bc8-665e-48f2-b26e-6a7d08f14313 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:00.986436 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5f5bc8-665e-48f2-b26e-6a7d08f14313 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:00.987208 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5f5bc8-665e-48f2-b26e-6a7d08f14313 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:00.987904 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5f5bc8-665e-48f2-b26e-6a7d08f14313 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:00.988921 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5f5bc8-665e-48f2-b26e-6a7d08f14313 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:00.989840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5f5bc8-665e-48f2-b26e-6a7d08f14313 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:00.990466 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5f5bc8-665e-48f2-b26e-6a7d08f14313 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:01.032984 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5f5bc8-665e-48f2-b26e-6a7d08f14313 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:01.033857 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5f5bc8-665e-48f2-b26e-6a7d08f14313 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:01.034513 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d5f5bc8-665e-48f2-b26e-6a7d08f14313 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:01.035186 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-7d5f5bc8-665e-48f2-b26e-6a7d08f14313 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lazy-loading 'fault' on Instance uuid 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:44:01.116971 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7d5f5bc8-665e-48f2-b26e-6a7d08f14313 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:01.124064 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7d5f5bc8-665e-48f2-b26e-6a7d08f14313 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 200 len: 1330 microversion: 2.1 time: 0.152941 Aug 29 20:44:01.124797 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 496/1013] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:00 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 1330 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:01.171483 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-91697061-1e23-49aa-91ed-fa041ba6edbc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:01.172143 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-91697061-1e23-49aa-91ed-fa041ba6edbc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:01.186045 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-91697061-1e23-49aa-91ed-fa041ba6edbc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:01.186786 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-91697061-1e23-49aa-91ed-fa041ba6edbc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:01.187398 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-91697061-1e23-49aa-91ed-fa041ba6edbc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:01.188366 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-91697061-1e23-49aa-91ed-fa041ba6edbc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:01.189003 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-91697061-1e23-49aa-91ed-fa041ba6edbc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:01.189587 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-91697061-1e23-49aa-91ed-fa041ba6edbc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:01.220228 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-91697061-1e23-49aa-91ed-fa041ba6edbc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Going to try to terminate instance {{(pid=127027) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:44:01.266144 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-d08bce66-4fa8-4a0a-9588-aafc43afcb76 req-b2bbd01c-3a1e-4f56-adf0-98ce69634348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f471db5-7c30-4af1-ac30-ca19749b20de", "tag": "4b1ee9cb-0447-4a61-8f14-6989ad0a92df"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:44:01.281673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d08bce66-4fa8-4a0a-9588-aafc43afcb76 req-b2bbd01c-3a1e-4f56-adf0-98ce69634348 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:01.282678 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d08bce66-4fa8-4a0a-9588-aafc43afcb76 req-b2bbd01c-3a1e-4f56-adf0-98ce69634348 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:01.283340 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-d08bce66-4fa8-4a0a-9588-aafc43afcb76 req-b2bbd01c-3a1e-4f56-adf0-98ce69634348 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:01.302955 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-d08bce66-4fa8-4a0a-9588-aafc43afcb76 req-b2bbd01c-3a1e-4f56-adf0-98ce69634348 service nova] Creating event network-changed:4b1ee9cb-0447-4a61-8f14-6989ad0a92df for instance 6f471db5-7c30-4af1-ac30-ca19749b20de on hv-cinder-85426 Aug 29 20:44:01.314682 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-d08bce66-4fa8-4a0a-9588-aafc43afcb76 req-b2bbd01c-3a1e-4f56-adf0-98ce69634348 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137815 Aug 29 20:44:01.315548 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 497/1014] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:44:01.339562 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-91697061-1e23-49aa-91ed-fa041ba6edbc tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 204 len: 0 microversion: 2.1 time: 0.172774 Aug 29 20:44:01.343656 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 518/1015] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:44:01 2022] DELETE /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:44:01.350041 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-025ddc9f-a800-4992-a4a6-524cc7200736 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:01.351688 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-025ddc9f-a800-4992-a4a6-524cc7200736 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:01.363476 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-025ddc9f-a800-4992-a4a6-524cc7200736 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:01.364096 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-025ddc9f-a800-4992-a4a6-524cc7200736 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:01.364536 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-025ddc9f-a800-4992-a4a6-524cc7200736 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:01.365284 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-025ddc9f-a800-4992-a4a6-524cc7200736 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:01.365738 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-025ddc9f-a800-4992-a4a6-524cc7200736 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:01.367249 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-025ddc9f-a800-4992-a4a6-524cc7200736 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:01.535499 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-025ddc9f-a800-4992-a4a6-524cc7200736 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:01.544101 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-025ddc9f-a800-4992-a4a6-524cc7200736 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1577 microversion: 2.1 time: 0.199028 Aug 29 20:44:01.544902 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 498/1016] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:01 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1577 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:44:02.146697 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-df3e769f-cd2b-40a9-b464-a2b26d9975d9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:02.147410 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-df3e769f-cd2b-40a9-b464-a2b26d9975d9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:02.154356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-df3e769f-cd2b-40a9-b464-a2b26d9975d9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:02.154839 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-df3e769f-cd2b-40a9-b464-a2b26d9975d9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:02.155340 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-df3e769f-cd2b-40a9-b464-a2b26d9975d9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:02.156069 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-df3e769f-cd2b-40a9-b464-a2b26d9975d9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:02.156516 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-df3e769f-cd2b-40a9-b464-a2b26d9975d9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:02.156984 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-df3e769f-cd2b-40a9-b464-a2b26d9975d9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:02.173893 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-df3e769f-cd2b-40a9-b464-a2b26d9975d9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] HTTP exception thrown: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-df3e769f-cd2b-40a9-b464-a2b26d9975d9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Request method failure captured: Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 HTTP/1.1 Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSSDqC88R7K8cLVWjZy4WK9zDiB6pwu9x2QyB2x9zAV7V1y0va6W2DKi7FyWua95fjBbT8Eyql-6591277ISk8v9v3fQo4yBhJRoK93DHfRmOWK_exB1IlX87Hj7Ic02JfSlZ4LRSLZeEIXK59FTaLzb4HU_ETTTTFo1lBGf3CBby0A Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:44:02.174906 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:44:02.176613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/076e4d9f49a944c487077e845726ad82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_076e4d9f49a944c487077e845726ad82"}]}] Aug 29 20:44:02.176613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:44:02.176613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:44:02.176613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:44:02.176613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:44:02.176613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:44:02.176613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:44:02.176613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 70aaca5187e54f25ad94d9515278e039 Aug 29 20:44:02.176613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:44:02.176613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:44:02.176613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:44:02.176613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '537b47db-7d5d-4bb8-8b81-b63759ecc7b8'} Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:44:02.177496 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:44:02.179066 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:02.180879 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-df3e769f-cd2b-40a9-b464-a2b26d9975d9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Returning 404 to user: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:44:02.180879 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-df3e769f-cd2b-40a9-b464-a2b26d9975d9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 404 len: 111 microversion: 2.1 time: 0.033898 Aug 29 20:44:02.180879 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 519/1017] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:02 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:44:02.185117 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9d622bcf-b6ad-458c-8955-1cf3511a4187 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '.version_select at 0x7f48630fa040>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:02.212390 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9d622bcf-b6ad-458c-8955-1cf3511a4187 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-275740109" status: 202 len: 0 microversion: 2.1 time: 0.031003 Aug 29 20:44:02.212963 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 499/1018] 10.222.0.18 () {58 vars in 1218 bytes} [Mon Aug 29 20:44:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-275740109 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:44:02.565976 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-2304d26f-99ca-478c-b942-d46df86660fe tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:02.566853 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-2304d26f-99ca-478c-b942-d46df86660fe tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:02.574287 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2304d26f-99ca-478c-b942-d46df86660fe tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:02.575027 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2304d26f-99ca-478c-b942-d46df86660fe tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:02.575533 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2304d26f-99ca-478c-b942-d46df86660fe tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:02.576277 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2304d26f-99ca-478c-b942-d46df86660fe tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:02.576889 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2304d26f-99ca-478c-b942-d46df86660fe tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:02.577307 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-2304d26f-99ca-478c-b942-d46df86660fe tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:02.855626 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-2304d26f-99ca-478c-b942-d46df86660fe tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:02.863882 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-2304d26f-99ca-478c-b942-d46df86660fe tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1577 microversion: 2.1 time: 0.301749 Aug 29 20:44:02.864486 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 520/1019] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:02 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1577 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:03.073753 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3d819941-5db7-49f8-9559-5bffad3003f2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:03.074738 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3d819941-5db7-49f8-9559-5bffad3003f2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:03.080389 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d819941-5db7-49f8-9559-5bffad3003f2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:03.080883 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d819941-5db7-49f8-9559-5bffad3003f2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:03.081342 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d819941-5db7-49f8-9559-5bffad3003f2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:03.082056 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d819941-5db7-49f8-9559-5bffad3003f2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:03.082513 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d819941-5db7-49f8-9559-5bffad3003f2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:03.082943 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3d819941-5db7-49f8-9559-5bffad3003f2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:03.189880 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-3d819941-5db7-49f8-9559-5bffad3003f2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lazy-loading 'services' on Instance uuid 2ea03034-17ef-42a5-af06-60d8e43be248 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:44:03.269516 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3d819941-5db7-49f8-9559-5bffad3003f2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248/os-volume_attachments/b552c6f6-bd24-40e2-973f-2251eb8e7d41" status: 202 len: 0 microversion: 2.1 time: 0.199615 Aug 29 20:44:03.270110 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 500/1020] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 29 20:44:03 2022] DELETE /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248/os-volume_attachments/b552c6f6-bd24-40e2-973f-2251eb8e7d41 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:44:03.279118 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4766341d-0211-4d09-b12b-8d12810f4e66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:03.281383 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4766341d-0211-4d09-b12b-8d12810f4e66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:03.287897 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4766341d-0211-4d09-b12b-8d12810f4e66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:03.288973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4766341d-0211-4d09-b12b-8d12810f4e66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:03.289395 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4766341d-0211-4d09-b12b-8d12810f4e66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:03.290088 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4766341d-0211-4d09-b12b-8d12810f4e66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:03.290541 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4766341d-0211-4d09-b12b-8d12810f4e66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:03.290963 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4766341d-0211-4d09-b12b-8d12810f4e66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:03.320874 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4766341d-0211-4d09-b12b-8d12810f4e66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045736 Aug 29 20:44:03.321333 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 521/1021] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:44:03 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:44:03.888906 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-8141f5af-f59b-4663-a97a-ff3ce0926ca0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:03.889599 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-8141f5af-f59b-4663-a97a-ff3ce0926ca0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:03.895761 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8141f5af-f59b-4663-a97a-ff3ce0926ca0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:03.896288 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8141f5af-f59b-4663-a97a-ff3ce0926ca0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:03.896725 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8141f5af-f59b-4663-a97a-ff3ce0926ca0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:03.897414 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8141f5af-f59b-4663-a97a-ff3ce0926ca0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:03.897868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8141f5af-f59b-4663-a97a-ff3ce0926ca0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:03.898294 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-8141f5af-f59b-4663-a97a-ff3ce0926ca0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:04.030772 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-8141f5af-f59b-4663-a97a-ff3ce0926ca0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:04.038514 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-8141f5af-f59b-4663-a97a-ff3ce0926ca0 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1577 microversion: 2.1 time: 0.154788 Aug 29 20:44:04.039071 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 501/1022] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:03 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:04.333467 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-a33a83d2-afb2-47cb-a13d-a950bed15bd8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:04.335668 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-a33a83d2-afb2-47cb-a13d-a950bed15bd8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:04.341902 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a33a83d2-afb2-47cb-a13d-a950bed15bd8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:04.342381 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a33a83d2-afb2-47cb-a13d-a950bed15bd8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:04.342808 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a33a83d2-afb2-47cb-a13d-a950bed15bd8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:04.343488 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a33a83d2-afb2-47cb-a13d-a950bed15bd8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:04.343958 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a33a83d2-afb2-47cb-a13d-a950bed15bd8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:04.344377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-a33a83d2-afb2-47cb-a13d-a950bed15bd8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:04.383965 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-a33a83d2-afb2-47cb-a13d-a950bed15bd8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054410 Aug 29 20:44:04.384993 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 522/1023] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:44:04 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:44:04.478552 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-23cd0d7c-ea30-4fcf-b2cc-f39052065c64 req-eac64823-d839-4d00-91b0-bc1f30e68f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f471db5-7c30-4af1-ac30-ca19749b20de", "name": "network-vif-deleted", "tag": "4b1ee9cb-0447-4a61-8f14-6989ad0a92df"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:44:04.495160 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-23cd0d7c-ea30-4fcf-b2cc-f39052065c64 req-eac64823-d839-4d00-91b0-bc1f30e68f1c service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:04.495898 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-23cd0d7c-ea30-4fcf-b2cc-f39052065c64 req-eac64823-d839-4d00-91b0-bc1f30e68f1c service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:04.496353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-23cd0d7c-ea30-4fcf-b2cc-f39052065c64 req-eac64823-d839-4d00-91b0-bc1f30e68f1c service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:04.508892 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-23cd0d7c-ea30-4fcf-b2cc-f39052065c64 req-eac64823-d839-4d00-91b0-bc1f30e68f1c service nova] Creating event network-vif-deleted:4b1ee9cb-0447-4a61-8f14-6989ad0a92df for instance 6f471db5-7c30-4af1-ac30-ca19749b20de on hv-cinder-85426 Aug 29 20:44:04.514766 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-23cd0d7c-ea30-4fcf-b2cc-f39052065c64 req-eac64823-d839-4d00-91b0-bc1f30e68f1c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039992 Aug 29 20:44:04.515599 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 502/1024] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:44:05.059516 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-73d4da52-4a40-48dd-867b-2030faa757ea tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:05.060153 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-73d4da52-4a40-48dd-867b-2030faa757ea tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:05.066036 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73d4da52-4a40-48dd-867b-2030faa757ea tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:05.066745 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73d4da52-4a40-48dd-867b-2030faa757ea tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:05.067174 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73d4da52-4a40-48dd-867b-2030faa757ea tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:05.067853 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73d4da52-4a40-48dd-867b-2030faa757ea tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:05.068330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73d4da52-4a40-48dd-867b-2030faa757ea tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:05.068760 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73d4da52-4a40-48dd-867b-2030faa757ea tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:05.099809 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73d4da52-4a40-48dd-867b-2030faa757ea tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:05.100306 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73d4da52-4a40-48dd-867b-2030faa757ea tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:05.100760 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-73d4da52-4a40-48dd-867b-2030faa757ea tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:05.101205 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-73d4da52-4a40-48dd-867b-2030faa757ea tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lazy-loading 'fault' on Instance uuid 6f471db5-7c30-4af1-ac30-ca19749b20de {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:44:05.144869 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-73d4da52-4a40-48dd-867b-2030faa757ea tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:05.153372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-73d4da52-4a40-48dd-867b-2030faa757ea tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 200 len: 1231 microversion: 2.1 time: 0.097709 Aug 29 20:44:05.153935 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 523/1025] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:05 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:05.396935 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-2d0c34e7-0c08-47ea-94b3-5f9f60ed8337 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:05.399408 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-2d0c34e7-0c08-47ea-94b3-5f9f60ed8337 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:05.405799 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d0c34e7-0c08-47ea-94b3-5f9f60ed8337 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:05.406383 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d0c34e7-0c08-47ea-94b3-5f9f60ed8337 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:05.406892 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d0c34e7-0c08-47ea-94b3-5f9f60ed8337 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:05.407673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d0c34e7-0c08-47ea-94b3-5f9f60ed8337 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:05.408202 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d0c34e7-0c08-47ea-94b3-5f9f60ed8337 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:05.408643 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-2d0c34e7-0c08-47ea-94b3-5f9f60ed8337 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:05.439014 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-2d0c34e7-0c08-47ea-94b3-5f9f60ed8337 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046295 Aug 29 20:44:05.439971 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 503/1026] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:44:05 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:44:05.506467 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-65cc2029-858e-48d4-9b3e-b190ceca4d8e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:05.507605 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-65cc2029-858e-48d4-9b3e-b190ceca4d8e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:05.513948 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-65cc2029-858e-48d4-9b3e-b190ceca4d8e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:05.514430 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-65cc2029-858e-48d4-9b3e-b190ceca4d8e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:05.514866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-65cc2029-858e-48d4-9b3e-b190ceca4d8e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:05.515566 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-65cc2029-858e-48d4-9b3e-b190ceca4d8e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:05.516042 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-65cc2029-858e-48d4-9b3e-b190ceca4d8e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:05.516467 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-65cc2029-858e-48d4-9b3e-b190ceca4d8e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:05.541874 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-65cc2029-858e-48d4-9b3e-b190ceca4d8e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Going to try to terminate instance {{(pid=127027) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:44:05.622536 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-65cc2029-858e-48d4-9b3e-b190ceca4d8e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 204 len: 0 microversion: 2.1 time: 0.119750 Aug 29 20:44:05.623459 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 524/1027] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:44:05 2022] DELETE /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:44:05.631705 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e647609-ba27-4c27-a5c5-f2b4bd64de81 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:05.633080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e647609-ba27-4c27-a5c5-f2b4bd64de81 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:05.639275 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e647609-ba27-4c27-a5c5-f2b4bd64de81 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:05.639832 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e647609-ba27-4c27-a5c5-f2b4bd64de81 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:05.640403 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e647609-ba27-4c27-a5c5-f2b4bd64de81 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:05.641186 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e647609-ba27-4c27-a5c5-f2b4bd64de81 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:05.641729 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e647609-ba27-4c27-a5c5-f2b4bd64de81 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:05.642220 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e647609-ba27-4c27-a5c5-f2b4bd64de81 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:05.799810 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e647609-ba27-4c27-a5c5-f2b4bd64de81 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:05.808615 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e647609-ba27-4c27-a5c5-f2b4bd64de81 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1682 microversion: 2.1 time: 0.180806 Aug 29 20:44:05.809171 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 504/1028] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:05 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:06.175318 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-47f56db5-dde9-4937-892d-e9712cbb1639 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:06.176037 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-47f56db5-dde9-4937-892d-e9712cbb1639 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 6f471db5-7c30-4af1-ac30-ca19749b20de] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:06.181890 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47f56db5-dde9-4937-892d-e9712cbb1639 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:06.182365 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47f56db5-dde9-4937-892d-e9712cbb1639 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:06.182797 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47f56db5-dde9-4937-892d-e9712cbb1639 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:06.183477 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47f56db5-dde9-4937-892d-e9712cbb1639 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:06.183924 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47f56db5-dde9-4937-892d-e9712cbb1639 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:06.184363 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-47f56db5-dde9-4937-892d-e9712cbb1639 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:06.197773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-47f56db5-dde9-4937-892d-e9712cbb1639 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] HTTP exception thrown: Instance 6f471db5-7c30-4af1-ac30-ca19749b20de could not be found. Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-47f56db5-dde9-4937-892d-e9712cbb1639 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Request method failure captured: Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de HTTP/1.1 Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSMYSVxW64nkLA8P_N2v2aoN6lTYVB5Un09vohqhSYYTSp-arzNka2pLHEI4EPsPgr_eNyw8PTiLEuyOgon_FBhgCJDSd9B7G9lc33quZ-AyW_EJD8RtAvJI0G0BYsGOElz4-5K4Q0vr180Z2fsBfZi6gH89JAnueulO7Gwo90NmUU8 Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 4ac573b4aa7a47c49d129afd9939e26d Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-TestVolumeBootPattern-717289528 Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:44:06.199372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:44:06.201026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4ac573b4aa7a47c49d129afd9939e26d"}]}] Aug 29 20:44:06.201026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-TestVolumeBootPattern-717289528 Aug 29 20:44:06.201026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 4ac573b4aa7a47c49d129afd9939e26d Aug 29 20:44:06.201026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-TestVolumeBootPattern-717289528 Aug 29 20:44:06.201026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-TestVolumeBootPattern-717289528-project Aug 29 20:44:06.201026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:44:06.201026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:44:06.201026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: fca06f41184444ccb0ddb57e5d44f227 Aug 29 20:44:06.201026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-TestVolumeBootPattern-717289528-project Aug 29 20:44:06.201026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:44:06.201026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 6f471db5-7c30-4af1-ac30-ca19749b20de could not be found. Aug 29 20:44:06.201026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '6f471db5-7c30-4af1-ac30-ca19749b20de'} Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f471db5-7c30-4af1-ac30-ca19749b20de could not be found. Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:44:06.201983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f471db5-7c30-4af1-ac30-ca19749b20de could not be found. Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f471db5-7c30-4af1-ac30-ca19749b20de could not be found. Aug 29 20:44:06.203661 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:06.205412 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-47f56db5-dde9-4937-892d-e9712cbb1639 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Returning 404 to user: Instance 6f471db5-7c30-4af1-ac30-ca19749b20de could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:44:06.205412 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-47f56db5-dde9-4937-892d-e9712cbb1639 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de" status: 404 len: 111 microversion: 2.1 time: 0.029729 Aug 29 20:44:06.205412 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 525/1029] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:06 2022] GET /compute/v2.1/servers/6f471db5-7c30-4af1-ac30-ca19749b20de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:44:06.830130 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f2b03e14-7923-4316-9d5c-4e15a0437260 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:06.830746 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f2b03e14-7923-4316-9d5c-4e15a0437260 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:06.837660 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2b03e14-7923-4316-9d5c-4e15a0437260 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:06.838138 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2b03e14-7923-4316-9d5c-4e15a0437260 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:06.838570 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2b03e14-7923-4316-9d5c-4e15a0437260 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:06.839260 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2b03e14-7923-4316-9d5c-4e15a0437260 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:06.839710 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2b03e14-7923-4316-9d5c-4e15a0437260 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:06.840277 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f2b03e14-7923-4316-9d5c-4e15a0437260 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:06.966834 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-f2b03e14-7923-4316-9d5c-4e15a0437260 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:06.974662 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f2b03e14-7923-4316-9d5c-4e15a0437260 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1682 microversion: 2.1 time: 0.148359 Aug 29 20:44:06.975207 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 505/1030] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:06 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:07.997068 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4b917756-ef28-4b15-ab27-38576ddfaf6f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:07.997719 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4b917756-ef28-4b15-ab27-38576ddfaf6f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:08.004534 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b917756-ef28-4b15-ab27-38576ddfaf6f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:08.005089 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b917756-ef28-4b15-ab27-38576ddfaf6f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:08.005524 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b917756-ef28-4b15-ab27-38576ddfaf6f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:08.006211 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b917756-ef28-4b15-ab27-38576ddfaf6f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:08.006674 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b917756-ef28-4b15-ab27-38576ddfaf6f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:08.007093 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4b917756-ef28-4b15-ab27-38576ddfaf6f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:08.139010 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4b917756-ef28-4b15-ab27-38576ddfaf6f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:08.147341 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4b917756-ef28-4b15-ab27-38576ddfaf6f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 200 len: 1682 microversion: 2.1 time: 0.154259 Aug 29 20:44:08.148014 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 526/1031] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:07 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:08.492059 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-14c305bc-3e09-461b-bd20-04b516552c4d req-cb4836fd-fc23-46be-8c53-bc1a40f134d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea03034-17ef-42a5-af06-60d8e43be248", "name": "network-vif-deleted", "tag": "7dac8a78-45b2-4c8a-a9c8-11b8dddbb08a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:44:08.508892 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-14c305bc-3e09-461b-bd20-04b516552c4d req-cb4836fd-fc23-46be-8c53-bc1a40f134d8 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:08.511393 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-14c305bc-3e09-461b-bd20-04b516552c4d req-cb4836fd-fc23-46be-8c53-bc1a40f134d8 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:08.514064 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-14c305bc-3e09-461b-bd20-04b516552c4d req-cb4836fd-fc23-46be-8c53-bc1a40f134d8 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:08.535353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-14c305bc-3e09-461b-bd20-04b516552c4d req-cb4836fd-fc23-46be-8c53-bc1a40f134d8 service nova] Creating event network-vif-deleted:7dac8a78-45b2-4c8a-a9c8-11b8dddbb08a for instance 2ea03034-17ef-42a5-af06-60d8e43be248 on hv-cinder-85426 Aug 29 20:44:08.544729 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-14c305bc-3e09-461b-bd20-04b516552c4d req-cb4836fd-fc23-46be-8c53-bc1a40f134d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056478 Aug 29 20:44:08.545614 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 506/1032] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:44:09.171154 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-02294450-b7a6-402b-981c-0dcc2ea0a81a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:09.172642 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-02294450-b7a6-402b-981c-0dcc2ea0a81a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:09.183560 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-02294450-b7a6-402b-981c-0dcc2ea0a81a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:09.184655 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-02294450-b7a6-402b-981c-0dcc2ea0a81a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:09.185159 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-02294450-b7a6-402b-981c-0dcc2ea0a81a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:09.186027 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-02294450-b7a6-402b-981c-0dcc2ea0a81a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:09.186649 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-02294450-b7a6-402b-981c-0dcc2ea0a81a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:09.187107 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-02294450-b7a6-402b-981c-0dcc2ea0a81a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:09.206007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-02294450-b7a6-402b-981c-0dcc2ea0a81a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] HTTP exception thrown: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-02294450-b7a6-402b-981c-0dcc2ea0a81a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Request method failure captured: Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 HTTP/1.1 Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSSDqC88R7K8cLVWjZy4WK9zDiB6pwu9x2QyB2x9zAV7V1y0va6W2DKi7FyWua95fjBbT8Eyql-6591277ISk8v9v3fQo4yBhJRoK93DHfRmOWK_exB1IlX87Hj7Ic02JfSlZ4LRSLZeEIXK59FTaLzb4HU_ETTTTFo1lBGf3CBby0A Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:44:09.207623 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:44:09.209424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/076e4d9f49a944c487077e845726ad82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_076e4d9f49a944c487077e845726ad82"}]}] Aug 29 20:44:09.209424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:44:09.209424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:44:09.209424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:44:09.209424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:44:09.209424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:44:09.209424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:44:09.209424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 70aaca5187e54f25ad94d9515278e039 Aug 29 20:44:09.209424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:44:09.209424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:44:09.209424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:44:09.209424 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '2ea03034-17ef-42a5-af06-60d8e43be248'} Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:44:09.211007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:44:09.212545 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:09.213910 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-02294450-b7a6-402b-981c-0dcc2ea0a81a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Returning 404 to user: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:44:09.213910 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-02294450-b7a6-402b-981c-0dcc2ea0a81a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 404 len: 111 microversion: 2.1 time: 0.042620 Aug 29 20:44:09.214091 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 527/1033] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:09 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:44:09.219576 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-96f73d68-a101-4ac5-913d-bebeb8a6cb1e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '.version_select at 0x7f48630c3160>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:09.244169 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-96f73d68-a101-4ac5-913d-bebeb8a6cb1e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641027586" status: 202 len: 0 microversion: 2.1 time: 0.028692 Aug 29 20:44:09.245022 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 507/1034] 10.222.0.18 () {58 vars in 1221 bytes} [Mon Aug 29 20:44:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641027586 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:44:09.416453 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-113775de-cce6-43ce-b59b-a86a32589c10 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:09.417457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-113775de-cce6-43ce-b59b-a86a32589c10 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:09.420226 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-00f3789d-3213-4dcd-bbad-5dd7673262f2 req-c398d55e-425d-44ba-b17f-356b09fa609a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570c9c7b-50b9-4879-bb2d-c91da2ead6b5", "tag": "740dee41-866c-4314-89ee-4f035ccd2e9a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:44:09.440951 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-00f3789d-3213-4dcd-bbad-5dd7673262f2 req-c398d55e-425d-44ba-b17f-356b09fa609a service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:09.445723 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-00f3789d-3213-4dcd-bbad-5dd7673262f2 req-c398d55e-425d-44ba-b17f-356b09fa609a service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:09.446431 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-00f3789d-3213-4dcd-bbad-5dd7673262f2 req-c398d55e-425d-44ba-b17f-356b09fa609a service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:09.451058 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-113775de-cce6-43ce-b59b-a86a32589c10 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:09.456743 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-113775de-cce6-43ce-b59b-a86a32589c10 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:09.457428 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-113775de-cce6-43ce-b59b-a86a32589c10 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:09.458462 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-113775de-cce6-43ce-b59b-a86a32589c10 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:09.459191 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-113775de-cce6-43ce-b59b-a86a32589c10 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:09.459922 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-113775de-cce6-43ce-b59b-a86a32589c10 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:09.467046 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:44:09.477363 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-00f3789d-3213-4dcd-bbad-5dd7673262f2 req-c398d55e-425d-44ba-b17f-356b09fa609a service nova] Creating event network-changed:740dee41-866c-4314-89ee-4f035ccd2e9a for instance 570c9c7b-50b9-4879-bb2d-c91da2ead6b5 on hv-cinder-85426 Aug 29 20:44:09.485737 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-00f3789d-3213-4dcd-bbad-5dd7673262f2 req-c398d55e-425d-44ba-b17f-356b09fa609a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069285 Aug 29 20:44:09.492672 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 508/1035] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:44:09.522203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-113775de-cce6-43ce-b59b-a86a32589c10 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Going to try to terminate instance {{(pid=127027) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:44:09.624244 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-113775de-cce6-43ce-b59b-a86a32589c10 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 204 len: 0 microversion: 2.1 time: 0.212313 Aug 29 20:44:09.625096 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 528/1036] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:44:09 2022] DELETE /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:44:09.642791 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-fd28d925-0c31-4a22-b8be-4a24008f8bd3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:09.644020 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-fd28d925-0c31-4a22-b8be-4a24008f8bd3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:09.653785 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd28d925-0c31-4a22-b8be-4a24008f8bd3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:09.654557 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd28d925-0c31-4a22-b8be-4a24008f8bd3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:09.655378 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd28d925-0c31-4a22-b8be-4a24008f8bd3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:09.656947 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd28d925-0c31-4a22-b8be-4a24008f8bd3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:09.657702 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd28d925-0c31-4a22-b8be-4a24008f8bd3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:09.658435 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-fd28d925-0c31-4a22-b8be-4a24008f8bd3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:10.126598 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-fd28d925-0c31-4a22-b8be-4a24008f8bd3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:10.135234 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-fd28d925-0c31-4a22-b8be-4a24008f8bd3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1575 microversion: 2.1 time: 0.505207 Aug 29 20:44:10.135805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 509/1037] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:09 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1575 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:10.408305 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-805a31fb-fe7a-48e2-8c07-1dba40b9e324 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Action: 'create', calling method: .version_select at 0x7f486326eee0>, body: {"keypair": {"name": "tempest-keypair-918288258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3p/lQbWHGx3bjWj4Ew+vZ7Wwo9xd/uKBhQEdEqKSPP4vD3fZdIR7MGfRJ4FV//+RcW46h5UfHnQP/vS5WzcJW/oOAzETOVf1aIMPZnLCTyTduKX1zMTxGZgJsHryy33w=="}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:44:10.425631 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-805a31fb-fe7a-48e2-8c07-1dba40b9e324 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for project 076e4d9f49a944c487077e845726ad82. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:44:10.429902 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-805a31fb-fe7a-48e2-8c07-1dba40b9e324 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for user 70aaca5187e54f25ad94d9515278e039 and project 076e4d9f49a944c487077e845726ad82. Resources: {'key_pairs'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:44:10.442879 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR oslo.messaging._drivers.impl_rabbit [None req-805a31fb-fe7a-48e2-8c07-1dba40b9e324 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [2e465be1-ee34-49ee-a7b7-56ce4af5ddca] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 20:44:11.156175 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-989169bd-9902-4c24-b626-35dad115e719 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:11.156571 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-989169bd-9902-4c24-b626-35dad115e719 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:11.162526 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-989169bd-9902-4c24-b626-35dad115e719 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:11.163008 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-989169bd-9902-4c24-b626-35dad115e719 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:11.163950 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-989169bd-9902-4c24-b626-35dad115e719 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:11.164657 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-989169bd-9902-4c24-b626-35dad115e719 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:11.165109 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-989169bd-9902-4c24-b626-35dad115e719 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:11.165525 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-989169bd-9902-4c24-b626-35dad115e719 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:11.374275 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-989169bd-9902-4c24-b626-35dad115e719 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:11.382166 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-989169bd-9902-4c24-b626-35dad115e719 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1575 microversion: 2.1 time: 0.230291 Aug 29 20:44:11.382721 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 510/1038] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:11 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:44:11.450964 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO oslo.messaging._drivers.impl_rabbit [None req-805a31fb-fe7a-48e2-8c07-1dba40b9e324 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [2e465be1-ee34-49ee-a7b7-56ce4af5ddca] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43856. Aug 29 20:44:11.468013 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-805a31fb-fe7a-48e2-8c07-1dba40b9e324 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.064237 Aug 29 20:44:11.468849 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 529/1039] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 29 20:44:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:44:12.054346 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-86a20aba-f5d4-4175-ac26-bf80261a5390 req-0b00a418-f6a3-4cbd-ae92-03e768271f83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570c9c7b-50b9-4879-bb2d-c91da2ead6b5", "name": "network-vif-deleted", "tag": "740dee41-866c-4314-89ee-4f035ccd2e9a"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:44:12.068646 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-86a20aba-f5d4-4175-ac26-bf80261a5390 req-0b00a418-f6a3-4cbd-ae92-03e768271f83 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:12.069777 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-86a20aba-f5d4-4175-ac26-bf80261a5390 req-0b00a418-f6a3-4cbd-ae92-03e768271f83 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:12.070157 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-86a20aba-f5d4-4175-ac26-bf80261a5390 req-0b00a418-f6a3-4cbd-ae92-03e768271f83 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:12.082490 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-86a20aba-f5d4-4175-ac26-bf80261a5390 req-0b00a418-f6a3-4cbd-ae92-03e768271f83 service nova] Creating event network-vif-deleted:740dee41-866c-4314-89ee-4f035ccd2e9a for instance 570c9c7b-50b9-4879-bb2d-c91da2ead6b5 on hv-cinder-85426 Aug 29 20:44:12.091968 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-86a20aba-f5d4-4175-ac26-bf80261a5390 req-0b00a418-f6a3-4cbd-ae92-03e768271f83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041697 Aug 29 20:44:12.093088 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 511/1040] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:44:12.406078 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-259f6289-d8c7-4752-b226-2a5e59d3ef8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:12.406903 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-259f6289-d8c7-4752-b226-2a5e59d3ef8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:12.419469 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-259f6289-d8c7-4752-b226-2a5e59d3ef8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:12.419983 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-259f6289-d8c7-4752-b226-2a5e59d3ef8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:12.420429 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-259f6289-d8c7-4752-b226-2a5e59d3ef8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:12.421308 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-259f6289-d8c7-4752-b226-2a5e59d3ef8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:12.421773 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-259f6289-d8c7-4752-b226-2a5e59d3ef8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:12.422198 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-259f6289-d8c7-4752-b226-2a5e59d3ef8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:12.461959 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-259f6289-d8c7-4752-b226-2a5e59d3ef8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:12.462596 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-259f6289-d8c7-4752-b226-2a5e59d3ef8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:12.462991 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-259f6289-d8c7-4752-b226-2a5e59d3ef8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:12.463500 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-259f6289-d8c7-4752-b226-2a5e59d3ef8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lazy-loading 'fault' on Instance uuid 570c9c7b-50b9-4879-bb2d-c91da2ead6b5 {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:44:12.508882 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-259f6289-d8c7-4752-b226-2a5e59d3ef8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca06f41184444ccb0ddb57e5d44f227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ac573b4aa7a47c49d129afd9939e26d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:12.519608 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-259f6289-d8c7-4752-b226-2a5e59d3ef8c tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 200 len: 1230 microversion: 2.1 time: 0.119656 Aug 29 20:44:12.520325 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 530/1041] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:12 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 1230 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:13.020946 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-547395473", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "931f5e99-b53b-4e33-bc47-b08971122f04"}], "security_groups": [{"name": "tempest-securitygroup--1428673692"}], "key_name": "tempest-keypair-918288258", "user_data": "}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:44:13.124759 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.network.neutron [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] validate_networks() for [('931f5e99-b53b-4e33-bc47-b08971122f04', None, None, None, None, None)] {{(pid=127028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:44:13.541520 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-54e7f335-24ff-408d-8aa7-73a3003016a3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:13.542139 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-54e7f335-24ff-408d-8aa7-73a3003016a3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 570c9c7b-50b9-4879-bb2d-c91da2ead6b5] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:13.548784 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54e7f335-24ff-408d-8aa7-73a3003016a3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:13.549273 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54e7f335-24ff-408d-8aa7-73a3003016a3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:13.549711 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54e7f335-24ff-408d-8aa7-73a3003016a3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:13.550418 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54e7f335-24ff-408d-8aa7-73a3003016a3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:13.550897 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54e7f335-24ff-408d-8aa7-73a3003016a3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:13.551319 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-54e7f335-24ff-408d-8aa7-73a3003016a3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:13.551904 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Flavor limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:44:13.552353 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Image limits 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:44:13.552824 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Flavor pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:44:13.553230 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Image pref 0:0:0 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:44:13.553642 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.virt.hardware [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:44:13.562550 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:13.563024 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:13.563456 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:13.564223 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:13.564704 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:13.565128 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:13.565313 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-54e7f335-24ff-408d-8aa7-73a3003016a3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] HTTP exception thrown: Instance 570c9c7b-50b9-4879-bb2d-c91da2ead6b5 could not be found. Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-54e7f335-24ff-408d-8aa7-73a3003016a3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Request method failure captured: Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 HTTP/1.1 Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSMYSVxW64nkLA8P_N2v2aoN6lTYVB5Un09vohqhSYYTSp-arzNka2pLHEI4EPsPgr_eNyw8PTiLEuyOgon_FBhgCJDSd9B7G9lc33quZ-AyW_EJD8RtAvJI0G0BYsGOElz4-5K4Q0vr180Z2fsBfZi6gH89JAnueulO7Gwo90NmUU8 Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 4ac573b4aa7a47c49d129afd9939e26d Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-TestVolumeBootPattern-717289528 Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:44:13.567253 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:44:13.568804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4ac573b4aa7a47c49d129afd9939e26d"}]}] Aug 29 20:44:13.568804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-TestVolumeBootPattern-717289528 Aug 29 20:44:13.568804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 4ac573b4aa7a47c49d129afd9939e26d Aug 29 20:44:13.568804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-TestVolumeBootPattern-717289528 Aug 29 20:44:13.568804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-TestVolumeBootPattern-717289528-project Aug 29 20:44:13.568804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:44:13.568804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:44:13.568804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: fca06f41184444ccb0ddb57e5d44f227 Aug 29 20:44:13.568804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-TestVolumeBootPattern-717289528-project Aug 29 20:44:13.568804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:44:13.568804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 570c9c7b-50b9-4879-bb2d-c91da2ead6b5 could not be found. Aug 29 20:44:13.568804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '570c9c7b-50b9-4879-bb2d-c91da2ead6b5'} Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570c9c7b-50b9-4879-bb2d-c91da2ead6b5 could not be found. Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:44:13.569613 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570c9c7b-50b9-4879-bb2d-c91da2ead6b5 could not be found. Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570c9c7b-50b9-4879-bb2d-c91da2ead6b5 could not be found. Aug 29 20:44:13.570989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:13.572145 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-54e7f335-24ff-408d-8aa7-73a3003016a3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Returning 404 to user: Instance 570c9c7b-50b9-4879-bb2d-c91da2ead6b5 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:44:13.572834 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-54e7f335-24ff-408d-8aa7-73a3003016a3 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5" status: 404 len: 111 microversion: 2.1 time: 0.035984 Aug 29 20:44:13.573405 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 531/1042] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:13 2022] GET /compute/v2.1/servers/570c9c7b-50b9-4879-bb2d-c91da2ead6b5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:44:13.582238 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for project 076e4d9f49a944c487077e845726ad82. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:44:13.586837 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for user 70aaca5187e54f25ad94d9515278e039 and project 076e4d9f49a944c487077e845726ad82. Resources: {'cores', 'ram', 'instances'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:44:13.597969 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Going to run 1 instances... {{(pid=127028) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:44:13.600374 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:44:13.644940 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [284fa60e-fd9a-469e-808c-35c0951a89b3] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 20:44:14.038026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ed157965-c83c-4ca6-ac8e-b3b96a71e3f2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:14.039007 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-ed157965-c83c-4ca6-ac8e-b3b96a71e3f2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:14.044892 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ed157965-c83c-4ca6-ac8e-b3b96a71e3f2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:14.045368 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ed157965-c83c-4ca6-ac8e-b3b96a71e3f2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:14.045796 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ed157965-c83c-4ca6-ac8e-b3b96a71e3f2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:14.046475 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ed157965-c83c-4ca6-ac8e-b3b96a71e3f2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:14.046926 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ed157965-c83c-4ca6-ac8e-b3b96a71e3f2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:14.047347 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-ed157965-c83c-4ca6-ac8e-b3b96a71e3f2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:14.060998 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-ed157965-c83c-4ca6-ac8e-b3b96a71e3f2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] HTTP exception thrown: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ed157965-c83c-4ca6-ac8e-b3b96a71e3f2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Request method failure captured: Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: DELETE /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa HTTP/1.1 Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSMYSVxW64nkLA8P_N2v2aoN6lTYVB5Un09vohqhSYYTSp-arzNka2pLHEI4EPsPgr_eNyw8PTiLEuyOgon_FBhgCJDSd9B7G9lc33quZ-AyW_EJD8RtAvJI0G0BYsGOElz4-5K4Q0vr180Z2fsBfZi6gH89JAnueulO7Gwo90NmUU8 Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 4ac573b4aa7a47c49d129afd9939e26d Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-TestVolumeBootPattern-717289528 Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:44:14.062512 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:44:14.064203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4ac573b4aa7a47c49d129afd9939e26d"}]}] Aug 29 20:44:14.064203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-TestVolumeBootPattern-717289528 Aug 29 20:44:14.064203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 4ac573b4aa7a47c49d129afd9939e26d Aug 29 20:44:14.064203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-TestVolumeBootPattern-717289528 Aug 29 20:44:14.064203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-TestVolumeBootPattern-717289528-project Aug 29 20:44:14.064203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:44:14.064203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:44:14.064203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: fca06f41184444ccb0ddb57e5d44f227 Aug 29 20:44:14.064203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-TestVolumeBootPattern-717289528-project Aug 29 20:44:14.064203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:44:14.064203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:44:14.064203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '1773df51-c30e-4b2d-8497-eb95021c3efa'} Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:44:14.065073 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:44:14.066419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:14.068380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-ed157965-c83c-4ca6-ac8e-b3b96a71e3f2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Returning 404 to user: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:44:14.068380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-ed157965-c83c-4ca6-ac8e-b3b96a71e3f2 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 404 len: 111 microversion: 2.1 time: 0.029845 Aug 29 20:44:14.068380 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 532/1043] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:44:14 2022] DELETE /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:44:14.072222 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6cfe519b-2633-431b-aa1e-01675aeabf96 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:14.072824 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6cfe519b-2633-431b-aa1e-01675aeabf96 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] [instance: 1773df51-c30e-4b2d-8497-eb95021c3efa] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:14.078330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6cfe519b-2633-431b-aa1e-01675aeabf96 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:14.078804 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6cfe519b-2633-431b-aa1e-01675aeabf96 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:14.079233 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6cfe519b-2633-431b-aa1e-01675aeabf96 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:14.079905 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6cfe519b-2633-431b-aa1e-01675aeabf96 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:14.080373 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6cfe519b-2633-431b-aa1e-01675aeabf96 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:14.080788 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6cfe519b-2633-431b-aa1e-01675aeabf96 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:14.093547 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-6cfe519b-2633-431b-aa1e-01675aeabf96 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] HTTP exception thrown: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6cfe519b-2633-431b-aa1e-01675aeabf96 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Request method failure captured: Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa HTTP/1.1 Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSMYSVxW64nkLA8P_N2v2aoN6lTYVB5Un09vohqhSYYTSp-arzNka2pLHEI4EPsPgr_eNyw8PTiLEuyOgon_FBhgCJDSd9B7G9lc33quZ-AyW_EJD8RtAvJI0G0BYsGOElz4-5K4Q0vr180Z2fsBfZi6gH89JAnueulO7Gwo90NmUU8 Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 4ac573b4aa7a47c49d129afd9939e26d Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-TestVolumeBootPattern-717289528 Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:44:14.095017 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:44:14.096754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ac573b4aa7a47c49d129afd9939e26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4ac573b4aa7a47c49d129afd9939e26d"}]}] Aug 29 20:44:14.096754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-TestVolumeBootPattern-717289528 Aug 29 20:44:14.096754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 4ac573b4aa7a47c49d129afd9939e26d Aug 29 20:44:14.096754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-TestVolumeBootPattern-717289528 Aug 29 20:44:14.096754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-TestVolumeBootPattern-717289528-project Aug 29 20:44:14.096754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:44:14.096754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:44:14.096754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: fca06f41184444ccb0ddb57e5d44f227 Aug 29 20:44:14.096754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-TestVolumeBootPattern-717289528-project Aug 29 20:44:14.096754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:44:14.096754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:44:14.096754 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '1773df51-c30e-4b2d-8497-eb95021c3efa'} Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:44:14.097895 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. Aug 29 20:44:14.099463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:44:14.101384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6cfe519b-2633-431b-aa1e-01675aeabf96 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Returning 404 to user: Instance 1773df51-c30e-4b2d-8497-eb95021c3efa could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:44:14.101384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6cfe519b-2633-431b-aa1e-01675aeabf96 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa" status: 404 len: 111 microversion: 2.1 time: 0.027636 Aug 29 20:44:14.101384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 533/1044] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:14 2022] GET /compute/v2.1/servers/1773df51-c30e-4b2d-8497-eb95021c3efa => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:44:14.654088 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO oslo.messaging._drivers.impl_rabbit [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [284fa60e-fd9a-469e-808c-35c0951a89b3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43900. Aug 29 20:44:14.658311 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-0f0ec61e-5ee4-4cc9-a887-22c10cf39158 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.642461 Aug 29 20:44:14.658954 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 512/1045] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:44:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:44:14.670398 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b8ded711-bc47-4267-ab2a-331b9a12f15b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:14.671022 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b8ded711-bc47-4267-ab2a-331b9a12f15b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:14.727273 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b8ded711-bc47-4267-ab2a-331b9a12f15b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:14.734204 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b8ded711-bc47-4267-ab2a-331b9a12f15b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1240 microversion: 2.1 time: 0.067752 Aug 29 20:44:14.734767 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 534/1046] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:14 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:15.408991 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b6bca9b5-abe5-423d-925e-0d8353b82647 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] Calling method '.version_select at 0x7f48631a7c10>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:15.432403 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b6bca9b5-abe5-423d-925e-0d8353b82647 tempest-TestVolumeBootPattern-717289528 tempest-TestVolumeBootPattern-717289528-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1635581417" status: 202 len: 0 microversion: 2.1 time: 0.027753 Aug 29 20:44:15.432869 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 513/1047] 10.222.0.18 () {58 vars in 1263 bytes} [Mon Aug 29 20:44:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1635581417 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:44:15.754683 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-097acd56-90ea-4e2b-8f8e-27ee808399f9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:15.756278 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-097acd56-90ea-4e2b-8f8e-27ee808399f9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:15.816923 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-097acd56-90ea-4e2b-8f8e-27ee808399f9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:15.823851 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-097acd56-90ea-4e2b-8f8e-27ee808399f9 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1240 microversion: 2.1 time: 0.073027 Aug 29 20:44:15.824455 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 535/1048] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:15 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:16.849542 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-adc379b0-4f97-479b-8b25-f3637dd6f1cc tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:16.850699 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-adc379b0-4f97-479b-8b25-f3637dd6f1cc tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:17.213858 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-adc379b0-4f97-479b-8b25-f3637dd6f1cc tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:17.223635 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-adc379b0-4f97-479b-8b25-f3637dd6f1cc tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1240 microversion: 2.1 time: 0.382081 Aug 29 20:44:17.224256 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 514/1049] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:16 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1240 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:44:18.252348 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8cf6cff7-9f05-4761-a1a9-b1b5ae24955f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:18.253671 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8cf6cff7-9f05-4761-a1a9-b1b5ae24955f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:18.267915 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8cf6cff7-9f05-4761-a1a9-b1b5ae24955f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:18.268540 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8cf6cff7-9f05-4761-a1a9-b1b5ae24955f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:18.268864 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8cf6cff7-9f05-4761-a1a9-b1b5ae24955f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:18.269578 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8cf6cff7-9f05-4761-a1a9-b1b5ae24955f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:18.270027 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8cf6cff7-9f05-4761-a1a9-b1b5ae24955f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:18.270445 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8cf6cff7-9f05-4761-a1a9-b1b5ae24955f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:18.348350 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8cf6cff7-9f05-4761-a1a9-b1b5ae24955f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:18.357214 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8cf6cff7-9f05-4761-a1a9-b1b5ae24955f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1244 microversion: 2.1 time: 0.116307 Aug 29 20:44:18.364095 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 536/1050] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:18 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1244 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:19.378468 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-92ac89af-c302-4566-ace7-760c09c25437 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:19.379603 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-92ac89af-c302-4566-ace7-760c09c25437 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:19.387129 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92ac89af-c302-4566-ace7-760c09c25437 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:19.387877 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92ac89af-c302-4566-ace7-760c09c25437 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:19.388501 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92ac89af-c302-4566-ace7-760c09c25437 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:19.389588 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92ac89af-c302-4566-ace7-760c09c25437 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:19.390261 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92ac89af-c302-4566-ace7-760c09c25437 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:19.390853 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-92ac89af-c302-4566-ace7-760c09c25437 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:19.456294 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-92ac89af-c302-4566-ace7-760c09c25437 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:19.465587 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-92ac89af-c302-4566-ace7-760c09c25437 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1244 microversion: 2.1 time: 0.090898 Aug 29 20:44:19.466206 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 515/1051] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:19 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:20.487249 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-d96e23eb-acf0-40fd-8bd4-dd7cbc9c639c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:20.487868 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-d96e23eb-acf0-40fd-8bd4-dd7cbc9c639c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:20.494025 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d96e23eb-acf0-40fd-8bd4-dd7cbc9c639c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:20.494503 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d96e23eb-acf0-40fd-8bd4-dd7cbc9c639c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:20.494935 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d96e23eb-acf0-40fd-8bd4-dd7cbc9c639c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:20.495633 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d96e23eb-acf0-40fd-8bd4-dd7cbc9c639c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:20.496117 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d96e23eb-acf0-40fd-8bd4-dd7cbc9c639c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:20.496541 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-d96e23eb-acf0-40fd-8bd4-dd7cbc9c639c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:20.602614 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-d96e23eb-acf0-40fd-8bd4-dd7cbc9c639c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:20.610701 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-d96e23eb-acf0-40fd-8bd4-dd7cbc9c639c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1298 microversion: 2.1 time: 0.127668 Aug 29 20:44:20.611278 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 537/1052] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:20 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1298 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:21.631755 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-53b4d6aa-b416-447c-8d10-37c097e5c8ce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:21.632410 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-53b4d6aa-b416-447c-8d10-37c097e5c8ce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:21.642290 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53b4d6aa-b416-447c-8d10-37c097e5c8ce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:21.642792 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53b4d6aa-b416-447c-8d10-37c097e5c8ce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:21.643227 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53b4d6aa-b416-447c-8d10-37c097e5c8ce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:21.652775 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53b4d6aa-b416-447c-8d10-37c097e5c8ce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:21.653429 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53b4d6aa-b416-447c-8d10-37c097e5c8ce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:21.653876 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-53b4d6aa-b416-447c-8d10-37c097e5c8ce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:21.685125 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:44:21.865492 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-89a5f3c1-42af-4846-a541-a93609544671 req-a3df0066-3eb9-4a4e-b393-a2ac3d6f2d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c72a3ce-9948-451c-8ca8-642d5dcb7447", "tag": "a296d8db-6069-49af-af25-18e201827ce2"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:44:21.867758 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-53b4d6aa-b416-447c-8d10-37c097e5c8ce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:21.879797 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-53b4d6aa-b416-447c-8d10-37c097e5c8ce tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1366 microversion: 2.1 time: 0.251703 Aug 29 20:44:21.893965 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-89a5f3c1-42af-4846-a541-a93609544671 req-a3df0066-3eb9-4a4e-b393-a2ac3d6f2d25 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:21.893965 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-89a5f3c1-42af-4846-a541-a93609544671 req-a3df0066-3eb9-4a4e-b393-a2ac3d6f2d25 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:21.893965 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-89a5f3c1-42af-4846-a541-a93609544671 req-a3df0066-3eb9-4a4e-b393-a2ac3d6f2d25 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:21.894919 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 516/1053] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:21 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:21.917125 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-89a5f3c1-42af-4846-a541-a93609544671 req-a3df0066-3eb9-4a4e-b393-a2ac3d6f2d25 service nova] Creating event network-changed:a296d8db-6069-49af-af25-18e201827ce2 for instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 on hv-cinder-85426 Aug 29 20:44:21.929628 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-89a5f3c1-42af-4846-a541-a93609544671 req-a3df0066-3eb9-4a4e-b393-a2ac3d6f2d25 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073885 Aug 29 20:44:21.930350 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 538/1054] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:44:22.902158 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-7d879ea2-fd01-4046-8670-f0db074f017f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:22.903010 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-7d879ea2-fd01-4046-8670-f0db074f017f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:22.909336 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d879ea2-fd01-4046-8670-f0db074f017f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:22.909899 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d879ea2-fd01-4046-8670-f0db074f017f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:22.910532 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d879ea2-fd01-4046-8670-f0db074f017f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:22.911309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d879ea2-fd01-4046-8670-f0db074f017f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:22.911844 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d879ea2-fd01-4046-8670-f0db074f017f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:22.912308 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-7d879ea2-fd01-4046-8670-f0db074f017f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:23.045988 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-7d879ea2-fd01-4046-8670-f0db074f017f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:23.054396 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-7d879ea2-fd01-4046-8670-f0db074f017f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1366 microversion: 2.1 time: 0.156432 Aug 29 20:44:23.054962 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 517/1055] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:22 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:24.075979 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9ab5dd50-ed99-44d2-b6fb-47a7ae95d64b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:24.076777 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9ab5dd50-ed99-44d2-b6fb-47a7ae95d64b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:24.083810 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9ab5dd50-ed99-44d2-b6fb-47a7ae95d64b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:24.084406 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9ab5dd50-ed99-44d2-b6fb-47a7ae95d64b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:24.085404 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9ab5dd50-ed99-44d2-b6fb-47a7ae95d64b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:24.086190 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9ab5dd50-ed99-44d2-b6fb-47a7ae95d64b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:24.086668 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9ab5dd50-ed99-44d2-b6fb-47a7ae95d64b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:24.087131 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9ab5dd50-ed99-44d2-b6fb-47a7ae95d64b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:24.217239 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9ab5dd50-ed99-44d2-b6fb-47a7ae95d64b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:24.226280 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9ab5dd50-ed99-44d2-b6fb-47a7ae95d64b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1366 microversion: 2.1 time: 0.154520 Aug 29 20:44:24.226881 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 539/1056] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:24 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:25.247903 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-05ecc685-28dc-4723-8ddc-b7cd94c2537a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:25.248645 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-05ecc685-28dc-4723-8ddc-b7cd94c2537a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:25.250687 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:44:25.257216 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05ecc685-28dc-4723-8ddc-b7cd94c2537a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:25.257716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05ecc685-28dc-4723-8ddc-b7cd94c2537a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:25.258192 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05ecc685-28dc-4723-8ddc-b7cd94c2537a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:25.259009 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05ecc685-28dc-4723-8ddc-b7cd94c2537a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:25.259537 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05ecc685-28dc-4723-8ddc-b7cd94c2537a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:25.260017 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-05ecc685-28dc-4723-8ddc-b7cd94c2537a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:25.395709 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-05ecc685-28dc-4723-8ddc-b7cd94c2537a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:25.403430 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-05ecc685-28dc-4723-8ddc-b7cd94c2537a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1366 microversion: 2.1 time: 0.159476 Aug 29 20:44:25.403997 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 518/1057] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:25 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:25.909100 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=8 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:44:26.094179 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-723eead7-3517-4e28-8219-01482a24af03 req-66e6552d-1dbf-4a24-b9c2-47d724039e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c72a3ce-9948-451c-8ca8-642d5dcb7447", "name": "network-vif-plugged", "status": "completed", "tag": "a296d8db-6069-49af-af25-18e201827ce2"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:44:26.104495 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-723eead7-3517-4e28-8219-01482a24af03 req-66e6552d-1dbf-4a24-b9c2-47d724039e89 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:26.104960 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-723eead7-3517-4e28-8219-01482a24af03 req-66e6552d-1dbf-4a24-b9c2-47d724039e89 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:26.105381 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-723eead7-3517-4e28-8219-01482a24af03 req-66e6552d-1dbf-4a24-b9c2-47d724039e89 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:26.115984 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-723eead7-3517-4e28-8219-01482a24af03 req-66e6552d-1dbf-4a24-b9c2-47d724039e89 service nova] Creating event network-vif-plugged:a296d8db-6069-49af-af25-18e201827ce2 for instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 on hv-cinder-85426 Aug 29 20:44:26.121552 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-723eead7-3517-4e28-8219-01482a24af03 req-66e6552d-1dbf-4a24-b9c2-47d724039e89 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217940 Aug 29 20:44:26.122182 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 540/1058] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:44:26.424116 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a629f562-0da4-428c-8db3-75d35493122f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:26.424748 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-a629f562-0da4-428c-8db3-75d35493122f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:26.431604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a629f562-0da4-428c-8db3-75d35493122f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:26.432141 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a629f562-0da4-428c-8db3-75d35493122f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:26.432572 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a629f562-0da4-428c-8db3-75d35493122f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:26.433261 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a629f562-0da4-428c-8db3-75d35493122f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:26.433713 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a629f562-0da4-428c-8db3-75d35493122f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:26.434134 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-a629f562-0da4-428c-8db3-75d35493122f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:26.575626 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-a629f562-0da4-428c-8db3-75d35493122f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:26.583243 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a629f562-0da4-428c-8db3-75d35493122f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1366 microversion: 2.1 time: 0.163029 Aug 29 20:44:26.583795 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 519/1059] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:26 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:27.611443 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9de584bc-ce5e-49b9-b6e1-4ff859036ceb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:27.612680 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9de584bc-ce5e-49b9-b6e1-4ff859036ceb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:27.615954 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:44:27.626128 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9de584bc-ce5e-49b9-b6e1-4ff859036ceb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:27.627026 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9de584bc-ce5e-49b9-b6e1-4ff859036ceb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:27.627847 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9de584bc-ce5e-49b9-b6e1-4ff859036ceb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:27.629090 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9de584bc-ce5e-49b9-b6e1-4ff859036ceb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:27.629909 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9de584bc-ce5e-49b9-b6e1-4ff859036ceb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:27.630681 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9de584bc-ce5e-49b9-b6e1-4ff859036ceb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:27.787121 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9de584bc-ce5e-49b9-b6e1-4ff859036ceb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:27.795888 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9de584bc-ce5e-49b9-b6e1-4ff859036ceb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1366 microversion: 2.1 time: 0.189349 Aug 29 20:44:27.796537 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 541/1060] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:27 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:28.817524 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5e2970d2-94c0-428d-873a-72a8c42b522a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:28.818137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5e2970d2-94c0-428d-873a-72a8c42b522a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:28.820623 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=8 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:44:28.821819 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:44:28.828455 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e2970d2-94c0-428d-873a-72a8c42b522a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:28.828938 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e2970d2-94c0-428d-873a-72a8c42b522a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:28.829378 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e2970d2-94c0-428d-873a-72a8c42b522a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:28.830074 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e2970d2-94c0-428d-873a-72a8c42b522a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:28.830529 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e2970d2-94c0-428d-873a-72a8c42b522a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:28.830962 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5e2970d2-94c0-428d-873a-72a8c42b522a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:28.962095 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5e2970d2-94c0-428d-873a-72a8c42b522a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:44:28.970028 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5e2970d2-94c0-428d-873a-72a8c42b522a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1556 microversion: 2.1 time: 0.156684 Aug 29 20:44:28.970631 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 520/1061] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:44:28 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:44:28.990907 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-196b834d-c3fa-41d1-87c8-8b0c30f0eafd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:44:28.992068 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-196b834d-c3fa-41d1-87c8-8b0c30f0eafd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:44:28.998493 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-196b834d-c3fa-41d1-87c8-8b0c30f0eafd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:28.998979 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-196b834d-c3fa-41d1-87c8-8b0c30f0eafd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:28.999419 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-196b834d-c3fa-41d1-87c8-8b0c30f0eafd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:29.000144 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-196b834d-c3fa-41d1-87c8-8b0c30f0eafd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:29.000604 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-196b834d-c3fa-41d1-87c8-8b0c30f0eafd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:29.001031 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-196b834d-c3fa-41d1-87c8-8b0c30f0eafd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:29.076222 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-196b834d-c3fa-41d1-87c8-8b0c30f0eafd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089494 Aug 29 20:44:29.076822 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 542/1062] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 29 20:44:28 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:44:30.246786 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-5137a005-727c-4656-8bfc-2ba6edf3a5ec req-2e35a72e-3065-4f8d-881d-105dd7e5eecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c72a3ce-9948-451c-8ca8-642d5dcb7447", "tag": "a296d8db-6069-49af-af25-18e201827ce2"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:44:30.256346 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5137a005-727c-4656-8bfc-2ba6edf3a5ec req-2e35a72e-3065-4f8d-881d-105dd7e5eecb service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:44:30.256814 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5137a005-727c-4656-8bfc-2ba6edf3a5ec req-2e35a72e-3065-4f8d-881d-105dd7e5eecb service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:44:30.257242 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-5137a005-727c-4656-8bfc-2ba6edf3a5ec req-2e35a72e-3065-4f8d-881d-105dd7e5eecb service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:44:30.270944 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-5137a005-727c-4656-8bfc-2ba6edf3a5ec req-2e35a72e-3065-4f8d-881d-105dd7e5eecb service nova] Creating event network-changed:a296d8db-6069-49af-af25-18e201827ce2 for instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 on hv-cinder-85426 Aug 29 20:44:30.276699 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-5137a005-727c-4656-8bfc-2ba6edf3a5ec req-2e35a72e-3065-4f8d-881d-105dd7e5eecb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033655 Aug 29 20:44:30.277293 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 521/1063] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:45:06.354871 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=3 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:06.355777 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:06.363153 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-de37fc96-72a3-4d84-97a6-ac007a41aaa8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:06.363763 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-de37fc96-72a3-4d84-97a6-ac007a41aaa8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:06.372196 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-de37fc96-72a3-4d84-97a6-ac007a41aaa8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:06.372928 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-de37fc96-72a3-4d84-97a6-ac007a41aaa8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:06.373372 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-de37fc96-72a3-4d84-97a6-ac007a41aaa8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:06.374585 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-de37fc96-72a3-4d84-97a6-ac007a41aaa8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:06.375362 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-de37fc96-72a3-4d84-97a6-ac007a41aaa8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:06.376126 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-de37fc96-72a3-4d84-97a6-ac007a41aaa8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:06.418370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-de37fc96-72a3-4d84-97a6-ac007a41aaa8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/ips" status: 200 len: 150 microversion: 2.1 time: 0.065392 Aug 29 20:45:06.418942 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 543/1064] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 29 20:45:06 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/ips => generated 150 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:45:07.786417 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4b950f91-2d4c-4c4d-a2e1-906ebba16fcc tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40929ee5-3a62-4f35-8f70-e59d98e55977"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:45:07.788989 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4b950f91-2d4c-4c4d-a2e1-906ebba16fcc tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:07.791368 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=3 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:07.792182 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=28 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:07.800523 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b950f91-2d4c-4c4d-a2e1-906ebba16fcc tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:07.801182 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b950f91-2d4c-4c4d-a2e1-906ebba16fcc tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:07.801672 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b950f91-2d4c-4c4d-a2e1-906ebba16fcc tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:07.802434 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b950f91-2d4c-4c4d-a2e1-906ebba16fcc tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:07.803525 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b950f91-2d4c-4c4d-a2e1-906ebba16fcc tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:07.804213 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4b950f91-2d4c-4c4d-a2e1-906ebba16fcc tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:08.100055 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4b950f91-2d4c-4c4d-a2e1-906ebba16fcc tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "POST /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318052 Aug 29 20:45:08.100673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 522/1065] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 29 20:45:07 2022] POST /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:45:14.621311 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b551c6c6-d99f-49ff-9e1a-6af29150c173 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40929ee5-3a62-4f35-8f70-e59d98e55977"}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:45:14.623752 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b551c6c6-d99f-49ff-9e1a-6af29150c173 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:14.630248 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b551c6c6-d99f-49ff-9e1a-6af29150c173 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:14.631230 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b551c6c6-d99f-49ff-9e1a-6af29150c173 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:14.631697 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b551c6c6-d99f-49ff-9e1a-6af29150c173 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:14.632520 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b551c6c6-d99f-49ff-9e1a-6af29150c173 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:14.632998 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b551c6c6-d99f-49ff-9e1a-6af29150c173 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:14.633427 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b551c6c6-d99f-49ff-9e1a-6af29150c173 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:14.713081 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-b551c6c6-d99f-49ff-9e1a-6af29150c173 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] HTTP exception thrown: Invalid volume: volume 40929ee5-3a62-4f35-8f70-e59d98e55977 is already attached to instances: 1c72a3ce-9948-451c-8ca8-642d5dcb7447 Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b551c6c6-d99f-49ff-9e1a-6af29150c173 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Request method failure captured: Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: POST /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/os-volume_attachments HTTP/1.1 Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 74 Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSSDqC88R7K8cLVWjZy4WK9zDiB6pwu9x2QyB2x9zAV7V1y0va6W2DKi7FyWua95fjBbT8Eyql-6591277ISk8v9v3fQo4yBhJRoK93DHfRmOWK_exB1IlX87Hj7Ic02JfSlZ4LRSLZeEIXK59FTaLzb4HU_ETTTTFo1lBGf3CBby0A Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:45:14.714795 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:45:14.716548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/076e4d9f49a944c487077e845726ad82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_076e4d9f49a944c487077e845726ad82"}]}] Aug 29 20:45:14.716548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:45:14.716548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:45:14.716548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:45:14.716548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:45:14.716548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:45:14.716548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:45:14.716548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 70aaca5187e54f25ad94d9515278e039 Aug 29 20:45:14.716548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:45:14.716548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Aug 29 20:45:14.716548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {"volumeAttachment": {"volumeId": "40929ee5-3a62-4f35-8f70-e59d98e55977"}} Aug 29 20:45:14.716548 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Invalid volume: volume 40929ee5-3a62-4f35-8f70-e59d98e55977 is already attached to instances: 1c72a3ce-9948-451c-8ca8-642d5dcb7447 Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'server_id': '1c72a3ce-9948-451c-8ca8-642d5dcb7447', 'body': {'volumeAttachment': {'volumeId': '40929ee5-3a62-4f35-8f70-e59d98e55977'}}} Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 40929ee5-3a62-4f35-8f70-e59d98e55977 is already attached to instances: 1c72a3ce-9948-451c-8ca8-642d5dcb7447 Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:45:14.717360 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 40929ee5-3a62-4f35-8f70-e59d98e55977 is already attached to instances: 1c72a3ce-9948-451c-8ca8-642d5dcb7447 Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:45:14.718789 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:45:14.720342 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:45:14.720342 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:45:14.720342 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:45:14.720342 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 40929ee5-3a62-4f35-8f70-e59d98e55977 is already attached to instances: 1c72a3ce-9948-451c-8ca8-642d5dcb7447 Aug 29 20:45:14.720342 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:45:14.720342 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b551c6c6-d99f-49ff-9e1a-6af29150c173 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Returning 400 to user: Invalid volume: volume 40929ee5-3a62-4f35-8f70-e59d98e55977 is already attached to instances: 1c72a3ce-9948-451c-8ca8-642d5dcb7447 {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:45:14.720342 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b551c6c6-d99f-49ff-9e1a-6af29150c173 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "POST /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099019 Aug 29 20:45:14.720342 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 544/1066] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 29 20:45:14 2022] POST /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 20:45:14.781050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4c278649-e019-4fa6-bf22-2f613bf8ed7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:14.781629 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4c278649-e019-4fa6-bf22-2f613bf8ed7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:14.788417 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c278649-e019-4fa6-bf22-2f613bf8ed7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:14.788897 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c278649-e019-4fa6-bf22-2f613bf8ed7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:14.789329 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c278649-e019-4fa6-bf22-2f613bf8ed7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:14.790026 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c278649-e019-4fa6-bf22-2f613bf8ed7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:14.790478 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c278649-e019-4fa6-bf22-2f613bf8ed7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:14.790899 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c278649-e019-4fa6-bf22-2f613bf8ed7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:14.871731 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.objects.instance [None req-4c278649-e019-4fa6-bf22-2f613bf8ed7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lazy-loading 'services' on Instance uuid 1c72a3ce-9948-451c-8ca8-642d5dcb7447 {{(pid=127028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:45:14.943442 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4c278649-e019-4fa6-bf22-2f613bf8ed7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/os-volume_attachments/40929ee5-3a62-4f35-8f70-e59d98e55977" status: 202 len: 0 microversion: 2.1 time: 0.167016 Aug 29 20:45:14.944071 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 523/1067] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 29 20:45:14 2022] DELETE /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/os-volume_attachments/40929ee5-3a62-4f35-8f70-e59d98e55977 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:45:14.952566 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-c3487078-1efe-4038-adb7-e1f910be5c39 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:14.954756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-c3487078-1efe-4038-adb7-e1f910be5c39 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:14.961919 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c3487078-1efe-4038-adb7-e1f910be5c39 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:14.962430 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c3487078-1efe-4038-adb7-e1f910be5c39 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:14.962854 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c3487078-1efe-4038-adb7-e1f910be5c39 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:14.963620 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c3487078-1efe-4038-adb7-e1f910be5c39 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:14.964040 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c3487078-1efe-4038-adb7-e1f910be5c39 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:14.964461 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-c3487078-1efe-4038-adb7-e1f910be5c39 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:14.995989 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-c3487078-1efe-4038-adb7-e1f910be5c39 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047388 Aug 29 20:45:14.997024 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 545/1068] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:45:14 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:45:16.009690 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-e23de426-dc1b-4b32-bf5f-f876b7eec932 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:16.012050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-e23de426-dc1b-4b32-bf5f-f876b7eec932 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:16.018248 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e23de426-dc1b-4b32-bf5f-f876b7eec932 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:16.018737 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e23de426-dc1b-4b32-bf5f-f876b7eec932 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:16.019165 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e23de426-dc1b-4b32-bf5f-f876b7eec932 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:16.019852 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e23de426-dc1b-4b32-bf5f-f876b7eec932 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:16.020326 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e23de426-dc1b-4b32-bf5f-f876b7eec932 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:16.020749 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-e23de426-dc1b-4b32-bf5f-f876b7eec932 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:16.050692 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-e23de426-dc1b-4b32-bf5f-f876b7eec932 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045853 Aug 29 20:45:16.051244 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 524/1069] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:45:16 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:45:16.112309 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-83992d07-ca5f-4692-be26-6848b07c9133 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:16.112853 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-83992d07-ca5f-4692-be26-6848b07c9133 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:16.119124 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-83992d07-ca5f-4692-be26-6848b07c9133 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:16.119600 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-83992d07-ca5f-4692-be26-6848b07c9133 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:16.120057 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-83992d07-ca5f-4692-be26-6848b07c9133 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:16.120749 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-83992d07-ca5f-4692-be26-6848b07c9133 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:16.121197 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-83992d07-ca5f-4692-be26-6848b07c9133 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:16.121610 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-83992d07-ca5f-4692-be26-6848b07c9133 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:16.149367 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-83992d07-ca5f-4692-be26-6848b07c9133 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Going to try to terminate instance {{(pid=127027) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:45:16.227725 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-83992d07-ca5f-4692-be26-6848b07c9133 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 204 len: 0 microversion: 2.1 time: 0.118915 Aug 29 20:45:16.228333 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 546/1070] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:45:16 2022] DELETE /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:45:16.236521 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-6e159edd-96bd-4592-aef8-60bd172fa2af tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:16.237137 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-6e159edd-96bd-4592-aef8-60bd172fa2af tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:16.243873 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e159edd-96bd-4592-aef8-60bd172fa2af tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:16.244392 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e159edd-96bd-4592-aef8-60bd172fa2af tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:16.244827 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e159edd-96bd-4592-aef8-60bd172fa2af tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:16.245522 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e159edd-96bd-4592-aef8-60bd172fa2af tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:16.245970 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e159edd-96bd-4592-aef8-60bd172fa2af tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:16.246403 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-6e159edd-96bd-4592-aef8-60bd172fa2af tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:16.376806 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-6e159edd-96bd-4592-aef8-60bd172fa2af tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:16.384810 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-6e159edd-96bd-4592-aef8-60bd172fa2af tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1681 microversion: 2.1 time: 0.152060 Aug 29 20:45:16.385415 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 525/1071] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:16 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:45:17.406000 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-8e545a00-071b-40aa-ae58-477b5fafb2c7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:17.406713 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-8e545a00-071b-40aa-ae58-477b5fafb2c7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:17.413832 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e545a00-071b-40aa-ae58-477b5fafb2c7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:17.414403 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e545a00-071b-40aa-ae58-477b5fafb2c7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:17.414798 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e545a00-071b-40aa-ae58-477b5fafb2c7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:17.415507 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e545a00-071b-40aa-ae58-477b5fafb2c7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:17.415977 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e545a00-071b-40aa-ae58-477b5fafb2c7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:17.416405 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-8e545a00-071b-40aa-ae58-477b5fafb2c7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:17.547502 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-8e545a00-071b-40aa-ae58-477b5fafb2c7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:17.555515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-8e545a00-071b-40aa-ae58-477b5fafb2c7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1681 microversion: 2.1 time: 0.153730 Aug 29 20:45:17.556111 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 547/1072] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:17 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:18.577326 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-5f5c92d7-b43a-4fb8-ae00-ca299efe7312 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:18.577968 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-5f5c92d7-b43a-4fb8-ae00-ca299efe7312 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:18.585150 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f5c92d7-b43a-4fb8-ae00-ca299efe7312 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:18.585841 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f5c92d7-b43a-4fb8-ae00-ca299efe7312 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:18.586275 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f5c92d7-b43a-4fb8-ae00-ca299efe7312 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:18.586970 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f5c92d7-b43a-4fb8-ae00-ca299efe7312 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:18.587417 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f5c92d7-b43a-4fb8-ae00-ca299efe7312 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:18.587835 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-5f5c92d7-b43a-4fb8-ae00-ca299efe7312 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:18.738570 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-5f5c92d7-b43a-4fb8-ae00-ca299efe7312 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:18.746733 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-5f5c92d7-b43a-4fb8-ae00-ca299efe7312 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 200 len: 1681 microversion: 2.1 time: 0.173243 Aug 29 20:45:18.747308 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 526/1073] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:18 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:19.001799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-f66d5bc9-c839-461c-b502-437a1a3d8f0a req-44a3e7b7-e19b-4d9b-b18c-ecdf98dd56ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c72a3ce-9948-451c-8ca8-642d5dcb7447", "name": "network-vif-deleted", "tag": "a296d8db-6069-49af-af25-18e201827ce2"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:45:19.014592 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-f66d5bc9-c839-461c-b502-437a1a3d8f0a req-44a3e7b7-e19b-4d9b-b18c-ecdf98dd56ed service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:19.015453 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-f66d5bc9-c839-461c-b502-437a1a3d8f0a req-44a3e7b7-e19b-4d9b-b18c-ecdf98dd56ed service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:19.016092 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-f66d5bc9-c839-461c-b502-437a1a3d8f0a req-44a3e7b7-e19b-4d9b-b18c-ecdf98dd56ed service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:19.028461 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-f66d5bc9-c839-461c-b502-437a1a3d8f0a req-44a3e7b7-e19b-4d9b-b18c-ecdf98dd56ed service nova] Creating event network-vif-deleted:a296d8db-6069-49af-af25-18e201827ce2 for instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 on hv-cinder-85426 Aug 29 20:45:19.033394 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-f66d5bc9-c839-461c-b502-437a1a3d8f0a req-44a3e7b7-e19b-4d9b-b18c-ecdf98dd56ed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035292 Aug 29 20:45:19.034075 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 548/1074] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:45:19.768573 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-738b1beb-01a7-4905-9d8b-d179be301584 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:19.769215 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-738b1beb-01a7-4905-9d8b-d179be301584 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:19.776551 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-738b1beb-01a7-4905-9d8b-d179be301584 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:19.777034 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-738b1beb-01a7-4905-9d8b-d179be301584 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:19.777465 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-738b1beb-01a7-4905-9d8b-d179be301584 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:19.778163 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-738b1beb-01a7-4905-9d8b-d179be301584 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:19.778611 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-738b1beb-01a7-4905-9d8b-d179be301584 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:19.779029 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-738b1beb-01a7-4905-9d8b-d179be301584 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:19.794432 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-738b1beb-01a7-4905-9d8b-d179be301584 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] HTTP exception thrown: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-738b1beb-01a7-4905-9d8b-d179be301584 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Request method failure captured: Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 HTTP/1.1 Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSSDqC88R7K8cLVWjZy4WK9zDiB6pwu9x2QyB2x9zAV7V1y0va6W2DKi7FyWua95fjBbT8Eyql-6591277ISk8v9v3fQo4yBhJRoK93DHfRmOWK_exB1IlX87Hj7Ic02JfSlZ4LRSLZeEIXK59FTaLzb4HU_ETTTTFo1lBGf3CBby0A Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:45:19.796118 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:45:19.797805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/076e4d9f49a944c487077e845726ad82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_076e4d9f49a944c487077e845726ad82"}]}] Aug 29 20:45:19.797805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:45:19.797805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:45:19.797805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:45:19.797805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:45:19.797805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:45:19.797805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:45:19.797805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 70aaca5187e54f25ad94d9515278e039 Aug 29 20:45:19.797805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:45:19.797805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:45:19.797805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:45:19.797805 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '1c72a3ce-9948-451c-8ca8-642d5dcb7447'} Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:45:19.798942 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:45:19.800597 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:45:19.802070 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-738b1beb-01a7-4905-9d8b-d179be301584 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Returning 404 to user: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:45:19.802070 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-738b1beb-01a7-4905-9d8b-d179be301584 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 404 len: 111 microversion: 2.1 time: 0.032895 Aug 29 20:45:19.802070 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 527/1075] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:19 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:45:19.808212 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-f482ef5f-516b-4b2e-af1e-f1224ba4bec6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '.version_select at 0x7f48632ebc10>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:19.831070 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-f482ef5f-516b-4b2e-af1e-f1224ba4bec6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-918288258" status: 202 len: 0 microversion: 2.1 time: 0.027815 Aug 29 20:45:19.831679 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 549/1076] 10.222.0.18 () {58 vars in 1218 bytes} [Mon Aug 29 20:45:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-918288258 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 20:45:20.465584 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-ca77c33e-4027-43be-a1e4-bf2571d8509a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Action: 'create', calling method: .version_select at 0x7f4863104790>, body: {"keypair": {"name": "tempest-keypair-1075365122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQgX4uEzVfv/v+xSczEe01iac5JzubZRgsuSycn5iA35yigAUdz8IeapVBRsZx5IoMhhJG64edCrpMSJh+spjpcV1rkPjBcBRfiRg7MGmGmSpaMzfgGqYadClmO4g2SxA=="}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:45:20.482111 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-ca77c33e-4027-43be-a1e4-bf2571d8509a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for project 076e4d9f49a944c487077e845726ad82. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:45:20.486226 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.quota [None req-ca77c33e-4027-43be-a1e4-bf2571d8509a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for user 70aaca5187e54f25ad94d9515278e039 and project 076e4d9f49a944c487077e845726ad82. Resources: {'key_pairs'} {{(pid=127028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:45:20.511868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-ca77c33e-4027-43be-a1e4-bf2571d8509a tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046590 Aug 29 20:45:20.511868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 528/1077] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Aug 29 20:45:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:45:21.855883 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-532809273", "imageRef": "ebda7059-d74e-4770-8fdb-bb89c45b26dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "931f5e99-b53b-4e33-bc47-b08971122f04"}], "security_groups": [{"name": "tempest-securitygroup--1280786944"}], "key_name": "tempest-keypair-1075365122", "user_data": "}} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:45:21.960150 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.network.neutron [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] validate_networks() for [('931f5e99-b53b-4e33-bc47-b08971122f04', None, None, None, None, None)] {{(pid=127027) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 20:45:22.473730 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Flavor limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 20:45:22.474669 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Image limits 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 20:45:22.475135 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Flavor pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 20:45:22.475721 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Image pref 0:0:0 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 20:45:22.476275 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.virt.hardware [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127027) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 20:45:22.485124 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:22.485604 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:22.486029 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:22.486748 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:22.487193 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:22.487609 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:22.505241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for project 076e4d9f49a944c487077e845726ad82. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 20:45:22.510157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.quota [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Getting quotas for user 70aaca5187e54f25ad94d9515278e039 and project 076e4d9f49a944c487077e845726ad82. Resources: {'cores', 'ram', 'instances'} {{(pid=127027) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 20:45:22.522029 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Going to run 1 instances... {{(pid=127027) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 20:45:22.524602 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ebda7059-d74e-4770-8fdb-bb89c45b26dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127027) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 20:45:22.574584 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-97a8aa53-67de-4ee8-a321-158ac01c70f6 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.723360 Aug 29 20:45:22.575241 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 550/1078] 10.222.0.18 () {60 vars in 1147 bytes} [Mon Aug 29 20:45:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 20:45:22.586987 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-70040d63-d1e5-468d-a6cc-59ab900b1389 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:22.587612 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-70040d63-d1e5-468d-a6cc-59ab900b1389 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:22.644661 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-70040d63-d1e5-468d-a6cc-59ab900b1389 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:22.652441 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-70040d63-d1e5-468d-a6cc-59ab900b1389 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 200 len: 1241 microversion: 2.1 time: 0.070225 Aug 29 20:45:22.653014 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 529/1079] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:22 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:23.674920 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-330d0ed8-5395-4262-b4a4-2e27d0b25e1c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:23.675703 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-330d0ed8-5395-4262-b4a4-2e27d0b25e1c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:23.684710 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-330d0ed8-5395-4262-b4a4-2e27d0b25e1c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:23.685327 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-330d0ed8-5395-4262-b4a4-2e27d0b25e1c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:23.686019 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-330d0ed8-5395-4262-b4a4-2e27d0b25e1c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:23.686807 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-330d0ed8-5395-4262-b4a4-2e27d0b25e1c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:23.687480 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-330d0ed8-5395-4262-b4a4-2e27d0b25e1c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:23.687988 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-330d0ed8-5395-4262-b4a4-2e27d0b25e1c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:23.761538 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-330d0ed8-5395-4262-b4a4-2e27d0b25e1c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:23.770009 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-330d0ed8-5395-4262-b4a4-2e27d0b25e1c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 200 len: 1301 microversion: 2.1 time: 0.099679 Aug 29 20:45:23.771273 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 551/1080] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:23 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 1301 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:24.791914 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-4c3ef961-01f4-4f08-a864-6172a9758051 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:24.792983 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-4c3ef961-01f4-4f08-a864-6172a9758051 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:24.799532 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c3ef961-01f4-4f08-a864-6172a9758051 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:24.800055 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c3ef961-01f4-4f08-a864-6172a9758051 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:24.800493 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c3ef961-01f4-4f08-a864-6172a9758051 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:24.801203 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c3ef961-01f4-4f08-a864-6172a9758051 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:24.801659 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c3ef961-01f4-4f08-a864-6172a9758051 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:24.802086 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-4c3ef961-01f4-4f08-a864-6172a9758051 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:24.946410 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-4c3ef961-01f4-4f08-a864-6172a9758051 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:24.955051 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-4c3ef961-01f4-4f08-a864-6172a9758051 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 200 len: 1367 microversion: 2.1 time: 0.167037 Aug 29 20:45:24.955709 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 530/1081] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:24 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:45:25.085402 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [req-5bcd9be0-7e56-4236-bc2d-26cc279324bd req-9123a5e4-3b51-4c16-b386-5120f5196a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7", "tag": "e15df8e4-5790-466f-89d7-f79b6820f447"}]} {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:45:25.096593 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-5bcd9be0-7e56-4236-bc2d-26cc279324bd req-9123a5e4-3b51-4c16-b386-5120f5196a78 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:25.096971 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-5bcd9be0-7e56-4236-bc2d-26cc279324bd req-9123a5e4-3b51-4c16-b386-5120f5196a78 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:25.097394 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [req-5bcd9be0-7e56-4236-bc2d-26cc279324bd req-9123a5e4-3b51-4c16-b386-5120f5196a78 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:25.109921 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.compute.server_external_events [req-5bcd9be0-7e56-4236-bc2d-26cc279324bd req-9123a5e4-3b51-4c16-b386-5120f5196a78 service nova] Creating event network-changed:e15df8e4-5790-466f-89d7-f79b6820f447 for instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 on hv-cinder-85426 Aug 29 20:45:25.115662 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [req-5bcd9be0-7e56-4236-bc2d-26cc279324bd req-9123a5e4-3b51-4c16-b386-5120f5196a78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033863 Aug 29 20:45:25.116310 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 552/1082] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:45:25.976197 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-d5d3081b-60f4-485a-88d6-1a858c3657ee tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:25.976840 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-d5d3081b-60f4-485a-88d6-1a858c3657ee tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:25.985827 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5d3081b-60f4-485a-88d6-1a858c3657ee tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:25.986760 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5d3081b-60f4-485a-88d6-1a858c3657ee tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:25.987426 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5d3081b-60f4-485a-88d6-1a858c3657ee tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:25.988804 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5d3081b-60f4-485a-88d6-1a858c3657ee tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:25.989592 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5d3081b-60f4-485a-88d6-1a858c3657ee tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:25.990436 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-d5d3081b-60f4-485a-88d6-1a858c3657ee tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:26.121458 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-d5d3081b-60f4-485a-88d6-1a858c3657ee tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:26.129107 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-d5d3081b-60f4-485a-88d6-1a858c3657ee tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 200 len: 1367 microversion: 2.1 time: 0.156918 Aug 29 20:45:26.129662 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 531/1083] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:25 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:27.151596 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b61afbdb-d2f7-4f88-b4c2-1341c6d93f5c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:27.152490 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b61afbdb-d2f7-4f88-b4c2-1341c6d93f5c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:27.158801 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b61afbdb-d2f7-4f88-b4c2-1341c6d93f5c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:27.159280 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b61afbdb-d2f7-4f88-b4c2-1341c6d93f5c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:27.159710 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b61afbdb-d2f7-4f88-b4c2-1341c6d93f5c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:27.160511 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b61afbdb-d2f7-4f88-b4c2-1341c6d93f5c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:27.160952 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b61afbdb-d2f7-4f88-b4c2-1341c6d93f5c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:27.161369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b61afbdb-d2f7-4f88-b4c2-1341c6d93f5c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:27.303873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-b61afbdb-d2f7-4f88-b4c2-1341c6d93f5c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:27.312366 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b61afbdb-d2f7-4f88-b4c2-1341c6d93f5c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 200 len: 1367 microversion: 2.1 time: 0.165451 Aug 29 20:45:27.312936 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 553/1084] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:27 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:28.333486 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-9516e3bc-02e9-4fc3-9d2d-9d25312a2a19 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:28.334147 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-9516e3bc-02e9-4fc3-9d2d-9d25312a2a19 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:28.341718 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9516e3bc-02e9-4fc3-9d2d-9d25312a2a19 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:28.342213 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9516e3bc-02e9-4fc3-9d2d-9d25312a2a19 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:28.342680 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9516e3bc-02e9-4fc3-9d2d-9d25312a2a19 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:28.343391 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9516e3bc-02e9-4fc3-9d2d-9d25312a2a19 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:28.343881 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9516e3bc-02e9-4fc3-9d2d-9d25312a2a19 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:28.344423 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-9516e3bc-02e9-4fc3-9d2d-9d25312a2a19 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:28.481780 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-9516e3bc-02e9-4fc3-9d2d-9d25312a2a19 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:28.490147 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-9516e3bc-02e9-4fc3-9d2d-9d25312a2a19 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 200 len: 1367 microversion: 2.1 time: 0.160572 Aug 29 20:45:28.491304 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 532/1085] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:28 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:29.511747 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6ad36b82-c2da-4084-8953-6e0b4c8afecd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:29.512379 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6ad36b82-c2da-4084-8953-6e0b4c8afecd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:29.518839 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6ad36b82-c2da-4084-8953-6e0b4c8afecd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:29.519311 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6ad36b82-c2da-4084-8953-6e0b4c8afecd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:29.519742 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6ad36b82-c2da-4084-8953-6e0b4c8afecd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:29.520460 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6ad36b82-c2da-4084-8953-6e0b4c8afecd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:29.520915 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6ad36b82-c2da-4084-8953-6e0b4c8afecd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:29.521330 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6ad36b82-c2da-4084-8953-6e0b4c8afecd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:29.658236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-6ad36b82-c2da-4084-8953-6e0b4c8afecd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:29.668808 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6ad36b82-c2da-4084-8953-6e0b4c8afecd tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 200 len: 1367 microversion: 2.1 time: 0.160912 Aug 29 20:45:29.669377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 554/1086] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:29 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:30.280052 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-bd4223e7-3b01-4325-aad9-01ec73534a1b req-5a135291-c559-416a-b475-6f42c7bf7b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7", "name": "network-vif-plugged", "status": "completed", "tag": "e15df8e4-5790-466f-89d7-f79b6820f447"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:45:30.290532 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bd4223e7-3b01-4325-aad9-01ec73534a1b req-5a135291-c559-416a-b475-6f42c7bf7b58 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:30.291010 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bd4223e7-3b01-4325-aad9-01ec73534a1b req-5a135291-c559-416a-b475-6f42c7bf7b58 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:30.291431 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-bd4223e7-3b01-4325-aad9-01ec73534a1b req-5a135291-c559-416a-b475-6f42c7bf7b58 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:30.303074 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-bd4223e7-3b01-4325-aad9-01ec73534a1b req-5a135291-c559-416a-b475-6f42c7bf7b58 service nova] Creating event network-vif-plugged:e15df8e4-5790-466f-89d7-f79b6820f447 for instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 on hv-cinder-85426 Aug 29 20:45:30.310241 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-bd4223e7-3b01-4325-aad9-01ec73534a1b req-5a135291-c559-416a-b475-6f42c7bf7b58 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033711 Aug 29 20:45:30.311385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 533/1087] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:45:30.689388 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-4157d209-3084-41e1-b9c2-7d7b4da7c45b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:30.690006 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-4157d209-3084-41e1-b9c2-7d7b4da7c45b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:30.697664 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4157d209-3084-41e1-b9c2-7d7b4da7c45b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:30.698157 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4157d209-3084-41e1-b9c2-7d7b4da7c45b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:30.698599 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4157d209-3084-41e1-b9c2-7d7b4da7c45b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:30.699306 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4157d209-3084-41e1-b9c2-7d7b4da7c45b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:30.699771 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4157d209-3084-41e1-b9c2-7d7b4da7c45b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:30.700236 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-4157d209-3084-41e1-b9c2-7d7b4da7c45b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:30.839333 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-4157d209-3084-41e1-b9c2-7d7b4da7c45b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:30.847303 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-4157d209-3084-41e1-b9c2-7d7b4da7c45b tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 200 len: 1367 microversion: 2.1 time: 0.161819 Aug 29 20:45:30.847880 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 555/1088] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:30 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:31.869101 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-66ed2cfa-047f-419e-b91f-1837606d0dd2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:31.869791 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-66ed2cfa-047f-419e-b91f-1837606d0dd2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:31.876372 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66ed2cfa-047f-419e-b91f-1837606d0dd2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:31.876853 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66ed2cfa-047f-419e-b91f-1837606d0dd2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:31.877282 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66ed2cfa-047f-419e-b91f-1837606d0dd2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:31.877979 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66ed2cfa-047f-419e-b91f-1837606d0dd2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:31.878445 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66ed2cfa-047f-419e-b91f-1837606d0dd2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:31.878845 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-66ed2cfa-047f-419e-b91f-1837606d0dd2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:32.017367 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-66ed2cfa-047f-419e-b91f-1837606d0dd2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:45:32.026211 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-66ed2cfa-047f-419e-b91f-1837606d0dd2 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 200 len: 1557 microversion: 2.1 time: 0.161876 Aug 29 20:45:32.026789 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 534/1089] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:45:31 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:45:32.048586 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-418d8058-aa98-4c68-9b26-93b2da4c9937 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:45:32.049195 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-418d8058-aa98-4c68-9b26-93b2da4c9937 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:45:32.055805 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-418d8058-aa98-4c68-9b26-93b2da4c9937 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:32.056708 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-418d8058-aa98-4c68-9b26-93b2da4c9937 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:32.057148 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-418d8058-aa98-4c68-9b26-93b2da4c9937 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:32.057852 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-418d8058-aa98-4c68-9b26-93b2da4c9937 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:32.058304 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-418d8058-aa98-4c68-9b26-93b2da4c9937 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:32.058731 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-418d8058-aa98-4c68-9b26-93b2da4c9937 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:32.147909 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-418d8058-aa98-4c68-9b26-93b2da4c9937 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104048 Aug 29 20:45:32.148629 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 556/1090] 10.222.0.18 () {58 vars in 1275 bytes} [Mon Aug 29 20:45:32 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:45:33.136521 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-61075a35-2cdd-473e-966f-3bcbd6ff67e7 req-0346fe9b-f6b1-4c94-88c9-9e51477e6736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7", "tag": "e15df8e4-5790-466f-89d7-f79b6820f447"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:45:33.141538 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell0:SELECT=6 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:33.148590 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-61075a35-2cdd-473e-966f-3bcbd6ff67e7 req-0346fe9b-f6b1-4c94-88c9-9e51477e6736 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:45:33.149081 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-61075a35-2cdd-473e-966f-3bcbd6ff67e7 req-0346fe9b-f6b1-4c94-88c9-9e51477e6736 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:45:33.149512 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-61075a35-2cdd-473e-966f-3bcbd6ff67e7 req-0346fe9b-f6b1-4c94-88c9-9e51477e6736 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:45:33.161293 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-61075a35-2cdd-473e-966f-3bcbd6ff67e7 req-0346fe9b-f6b1-4c94-88c9-9e51477e6736 service nova] Creating event network-changed:e15df8e4-5790-466f-89d7-f79b6820f447 for instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 on hv-cinder-85426 Aug 29 20:45:33.168391 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-61075a35-2cdd-473e-966f-3bcbd6ff67e7 req-0346fe9b-f6b1-4c94-88c9-9e51477e6736 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035505 Aug 29 20:45:33.168994 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 535/1091] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 20:46:09.462615 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=2 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:09.463413 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell0:SELECT=6 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:09.464954 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:09.465579 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG dbcounter [-] [127027] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:09.469866 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-14258e18-5ed5-44c2-929b-211a09eacc30 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:09.470378 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-14258e18-5ed5-44c2-929b-211a09eacc30 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:09.479889 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-14258e18-5ed5-44c2-929b-211a09eacc30 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:09.480413 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-14258e18-5ed5-44c2-929b-211a09eacc30 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:09.480864 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-14258e18-5ed5-44c2-929b-211a09eacc30 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:09.481988 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-14258e18-5ed5-44c2-929b-211a09eacc30 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:09.482455 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-14258e18-5ed5-44c2-929b-211a09eacc30 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:09.482882 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-14258e18-5ed5-44c2-929b-211a09eacc30 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:09.512587 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-14258e18-5ed5-44c2-929b-211a09eacc30 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7/ips" status: 200 len: 150 microversion: 2.1 time: 0.050467 Aug 29 20:46:09.513191 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 557/1092] 10.222.0.18 () {58 vars in 1248 bytes} [Mon Aug 29 20:46:09 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:46:10.912166 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:10.912941 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG dbcounter [-] [127028] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:46:10.917580 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-f6d2592f-4b47-48d9-b27e-e135918e7514 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e28b2edb-ac8a-4be8-9880-1354bbd4f825"}} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:46:10.920029 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-f6d2592f-4b47-48d9-b27e-e135918e7514 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:10.928301 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d2592f-4b47-48d9-b27e-e135918e7514 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:10.928788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d2592f-4b47-48d9-b27e-e135918e7514 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:10.929230 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d2592f-4b47-48d9-b27e-e135918e7514 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:10.929939 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d2592f-4b47-48d9-b27e-e135918e7514 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:10.930400 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d2592f-4b47-48d9-b27e-e135918e7514 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:10.930817 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-f6d2592f-4b47-48d9-b27e-e135918e7514 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:11.222624 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-f6d2592f-4b47-48d9-b27e-e135918e7514 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "POST /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312017 Aug 29 20:46:11.223788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 536/1093] 10.222.0.18 () {60 vars in 1323 bytes} [Mon Aug 29 20:46:10 2022] POST /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:46:17.836703 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-6ba39efc-731b-4d49-a462-18ccc72f8bb8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:17.837301 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-6ba39efc-731b-4d49-a462-18ccc72f8bb8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:17.843870 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6ba39efc-731b-4d49-a462-18ccc72f8bb8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:17.844394 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6ba39efc-731b-4d49-a462-18ccc72f8bb8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:17.844868 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6ba39efc-731b-4d49-a462-18ccc72f8bb8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:17.845580 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6ba39efc-731b-4d49-a462-18ccc72f8bb8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:17.846039 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6ba39efc-731b-4d49-a462-18ccc72f8bb8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:17.846462 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-6ba39efc-731b-4d49-a462-18ccc72f8bb8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:17.935187 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.objects.instance [None req-6ba39efc-731b-4d49-a462-18ccc72f8bb8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lazy-loading 'services' on Instance uuid 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 {{(pid=127027) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 20:46:18.020440 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-6ba39efc-731b-4d49-a462-18ccc72f8bb8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7/os-volume_attachments/e28b2edb-ac8a-4be8-9880-1354bbd4f825" status: 202 len: 0 microversion: 2.1 time: 0.188697 Aug 29 20:46:18.021061 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 558/1094] 10.222.0.18 () {58 vars in 1416 bytes} [Mon Aug 29 20:46:17 2022] DELETE /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7/os-volume_attachments/e28b2edb-ac8a-4be8-9880-1354bbd4f825 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:46:18.031110 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-146d7481-97ea-4e89-b7a8-a38bbff9a14f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:18.033604 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-146d7481-97ea-4e89-b7a8-a38bbff9a14f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:18.042259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-146d7481-97ea-4e89-b7a8-a38bbff9a14f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:18.042259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-146d7481-97ea-4e89-b7a8-a38bbff9a14f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:18.042259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-146d7481-97ea-4e89-b7a8-a38bbff9a14f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:18.042259 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-146d7481-97ea-4e89-b7a8-a38bbff9a14f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:18.043518 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-146d7481-97ea-4e89-b7a8-a38bbff9a14f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:18.043518 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-146d7481-97ea-4e89-b7a8-a38bbff9a14f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:18.079041 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-146d7481-97ea-4e89-b7a8-a38bbff9a14f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052830 Aug 29 20:46:18.079613 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 537/1095] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:46:18 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:46:19.092267 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7c996a7f-83a2-4ba3-94f9-cd572d2b46d8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:19.094758 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7c996a7f-83a2-4ba3-94f9-cd572d2b46d8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:19.102071 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7c996a7f-83a2-4ba3-94f9-cd572d2b46d8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:19.102598 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7c996a7f-83a2-4ba3-94f9-cd572d2b46d8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:19.103039 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7c996a7f-83a2-4ba3-94f9-cd572d2b46d8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:19.103763 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7c996a7f-83a2-4ba3-94f9-cd572d2b46d8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:19.104255 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7c996a7f-83a2-4ba3-94f9-cd572d2b46d8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:19.104711 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7c996a7f-83a2-4ba3-94f9-cd572d2b46d8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:19.136881 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7c996a7f-83a2-4ba3-94f9-cd572d2b46d8 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049612 Aug 29 20:46:19.137458 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 559/1096] 10.222.0.18 () {58 vars in 1302 bytes} [Mon Aug 29 20:46:19 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 20:46:19.201697 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-b0aab447-eb18-4d77-8db3-99e24e319465 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:19.202323 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0aab447-eb18-4d77-8db3-99e24e319465 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:19.209672 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0aab447-eb18-4d77-8db3-99e24e319465 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:19.210191 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0aab447-eb18-4d77-8db3-99e24e319465 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:19.210691 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0aab447-eb18-4d77-8db3-99e24e319465 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:19.211483 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0aab447-eb18-4d77-8db3-99e24e319465 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:19.211981 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0aab447-eb18-4d77-8db3-99e24e319465 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:19.212407 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-b0aab447-eb18-4d77-8db3-99e24e319465 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:19.239978 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-b0aab447-eb18-4d77-8db3-99e24e319465 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Going to try to terminate instance {{(pid=127028) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 20:46:19.329155 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-b0aab447-eb18-4d77-8db3-99e24e319465 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 204 len: 0 microversion: 2.1 time: 0.131227 Aug 29 20:46:19.329753 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 538/1097] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:46:19 2022] DELETE /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 20:46:19.338780 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-9d4e6500-3a79-41a0-b545-49f23c5cee7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:19.339399 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-9d4e6500-3a79-41a0-b545-49f23c5cee7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:19.345637 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9d4e6500-3a79-41a0-b545-49f23c5cee7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:19.346054 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9d4e6500-3a79-41a0-b545-49f23c5cee7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:19.346487 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9d4e6500-3a79-41a0-b545-49f23c5cee7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:19.347203 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9d4e6500-3a79-41a0-b545-49f23c5cee7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:19.347650 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9d4e6500-3a79-41a0-b545-49f23c5cee7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:19.348095 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-9d4e6500-3a79-41a0-b545-49f23c5cee7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:19.496951 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-9d4e6500-3a79-41a0-b545-49f23c5cee7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:46:19.504749 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-9d4e6500-3a79-41a0-b545-49f23c5cee7e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 200 len: 1682 microversion: 2.1 time: 0.169859 Aug 29 20:46:19.506000 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 560/1098] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:46:19 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:46:20.530540 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-59949192-28d5-47ed-adc5-e53f3b21ea4c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:20.531536 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-59949192-28d5-47ed-adc5-e53f3b21ea4c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:20.539289 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59949192-28d5-47ed-adc5-e53f3b21ea4c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:20.539773 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59949192-28d5-47ed-adc5-e53f3b21ea4c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:20.540239 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59949192-28d5-47ed-adc5-e53f3b21ea4c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:20.540949 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59949192-28d5-47ed-adc5-e53f3b21ea4c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:20.541411 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59949192-28d5-47ed-adc5-e53f3b21ea4c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:20.541886 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-59949192-28d5-47ed-adc5-e53f3b21ea4c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:20.679362 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.policy [None req-59949192-28d5-47ed-adc5-e53f3b21ea4c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127028) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:46:20.687569 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-59949192-28d5-47ed-adc5-e53f3b21ea4c tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 200 len: 1682 microversion: 2.1 time: 0.163446 Aug 29 20:46:20.688170 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 539/1099] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:46:20 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 20:46:21.712043 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-97c57190-3571-4064-89e1-907c7f489feb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:21.714531 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-97c57190-3571-4064-89e1-907c7f489feb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:21.726911 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-97c57190-3571-4064-89e1-907c7f489feb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:21.727892 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-97c57190-3571-4064-89e1-907c7f489feb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:21.728631 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-97c57190-3571-4064-89e1-907c7f489feb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:21.729822 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-97c57190-3571-4064-89e1-907c7f489feb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:21.730659 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-97c57190-3571-4064-89e1-907c7f489feb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:21.731474 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-97c57190-3571-4064-89e1-907c7f489feb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:21.808141 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.policy [None req-97c57190-3571-4064-89e1-907c7f489feb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aaca5187e54f25ad94d9515278e039', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076e4d9f49a944c487077e845726ad82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127027) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 20:46:21.815913 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-97c57190-3571-4064-89e1-907c7f489feb tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 200 len: 1614 microversion: 2.1 time: 0.109630 Aug 29 20:46:21.816533 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 561/1100] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:46:21 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 1614 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 20:46:22.075309 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [req-f43a49ab-be71-4b88-9692-24503c14c3c3 req-aac52371-acac-4034-beda-20095685aba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7", "name": "network-vif-deleted", "tag": "e15df8e4-5790-466f-89d7-f79b6820f447"}]} {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 20:46:22.086615 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f43a49ab-be71-4b88-9692-24503c14c3c3 req-aac52371-acac-4034-beda-20095685aba3 service nova] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:22.087102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f43a49ab-be71-4b88-9692-24503c14c3c3 req-aac52371-acac-4034-beda-20095685aba3 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:22.087532 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [req-f43a49ab-be71-4b88-9692-24503c14c3c3 req-aac52371-acac-4034-beda-20095685aba3 service nova] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:22.104914 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.compute.server_external_events [req-f43a49ab-be71-4b88-9692-24503c14c3c3 req-aac52371-acac-4034-beda-20095685aba3 service nova] Creating event network-vif-deleted:e15df8e4-5790-466f-89d7-f79b6820f447 for instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 on hv-cinder-85426 Aug 29 20:46:22.109959 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [req-f43a49ab-be71-4b88-9692-24503c14c3c3 req-aac52371-acac-4034-beda-20095685aba3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038537 Aug 29 20:46:22.110601 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 540/1101] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Aug 29 20:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 20:46:22.838484 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b465e0b9-aa7b-4684-adeb-7d12c2a4ea0f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:22.839107 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-b465e0b9-aa7b-4684-adeb-7d12c2a4ea0f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:22.845842 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b465e0b9-aa7b-4684-adeb-7d12c2a4ea0f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:22.846345 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b465e0b9-aa7b-4684-adeb-7d12c2a4ea0f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:22.846778 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b465e0b9-aa7b-4684-adeb-7d12c2a4ea0f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:22.847497 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b465e0b9-aa7b-4684-adeb-7d12c2a4ea0f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:22.847964 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b465e0b9-aa7b-4684-adeb-7d12c2a4ea0f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:22.848398 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-b465e0b9-aa7b-4684-adeb-7d12c2a4ea0f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:22.864636 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-b465e0b9-aa7b-4684-adeb-7d12c2a4ea0f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] HTTP exception thrown: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b465e0b9-aa7b-4684-adeb-7d12c2a4ea0f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Request method failure captured: Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 HTTP/1.1 Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSSDqC88R7K8cLVWjZy4WK9zDiB6pwu9x2QyB2x9zAV7V1y0va6W2DKi7FyWua95fjBbT8Eyql-6591277ISk8v9v3fQo4yBhJRoK93DHfRmOWK_exB1IlX87Hj7Ic02JfSlZ4LRSLZeEIXK59FTaLzb4HU_ETTTTFo1lBGf3CBby0A Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:46:22.866356 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:46:22.868377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/076e4d9f49a944c487077e845726ad82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_076e4d9f49a944c487077e845726ad82"}]}] Aug 29 20:46:22.868377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:22.868377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:22.868377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:22.868377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:22.868377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:46:22.868377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:46:22.868377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 70aaca5187e54f25ad94d9515278e039 Aug 29 20:46:22.868377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:22.868377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:46:22.868377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:22.868377 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7'} Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:46:22.869485 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:22.871369 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:22.872912 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-b465e0b9-aa7b-4684-adeb-7d12c2a4ea0f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Returning 404 to user: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:46:22.872912 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-b465e0b9-aa7b-4684-adeb-7d12c2a4ea0f tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 404 len: 111 microversion: 2.1 time: 0.033354 Aug 29 20:46:22.872912 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 562/1102] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:46:22 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:46:22.879162 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-a22e6827-3916-413b-b036-e462be01d498 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '.version_select at 0x7f4863104940>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:22.901622 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-a22e6827-3916-413b-b036-e462be01d498 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075365122" status: 202 len: 0 microversion: 2.1 time: 0.026495 Aug 29 20:46:22.902218 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 541/1103] 10.222.0.18 () {58 vars in 1221 bytes} [Mon Aug 29 20:46:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075365122 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 20:46:24.075826 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-524b7400-62bb-4766-8689-0df98a889d6e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:24.076473 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-524b7400-62bb-4766-8689-0df98a889d6e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:24.084159 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-524b7400-62bb-4766-8689-0df98a889d6e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:24.084655 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-524b7400-62bb-4766-8689-0df98a889d6e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:24.085364 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-524b7400-62bb-4766-8689-0df98a889d6e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:24.085887 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-524b7400-62bb-4766-8689-0df98a889d6e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:24.086373 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-524b7400-62bb-4766-8689-0df98a889d6e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:24.086790 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-524b7400-62bb-4766-8689-0df98a889d6e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:24.102636 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-524b7400-62bb-4766-8689-0df98a889d6e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] HTTP exception thrown: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-524b7400-62bb-4766-8689-0df98a889d6e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Request method failure captured: Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: DELETE /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 HTTP/1.1 Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSSDqC88R7K8cLVWjZy4WK9zDiB6pwu9x2QyB2x9zAV7V1y0va6W2DKi7FyWua95fjBbT8Eyql-6591277ISk8v9v3fQo4yBhJRoK93DHfRmOWK_exB1IlX87Hj7Ic02JfSlZ4LRSLZeEIXK59FTaLzb4HU_ETTTTFo1lBGf3CBby0A Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:46:24.104232 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:46:24.105955 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/076e4d9f49a944c487077e845726ad82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_076e4d9f49a944c487077e845726ad82"}]}] Aug 29 20:46:24.105955 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:24.105955 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:24.105955 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:24.105955 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:24.105955 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:46:24.105955 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:46:24.105955 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 70aaca5187e54f25ad94d9515278e039 Aug 29 20:46:24.105955 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:24.105955 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:46:24.105955 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:24.105955 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7'} Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:46:24.107049 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:24.110799 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:24.113378 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-524b7400-62bb-4766-8689-0df98a889d6e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Returning 404 to user: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:46:24.113378 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-524b7400-62bb-4766-8689-0df98a889d6e tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 404 len: 111 microversion: 2.1 time: 0.033808 Aug 29 20:46:24.113378 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 563/1104] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:46:24 2022] DELETE /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:46:24.115072 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-973bdd0c-e395-4fdf-9b5f-6e01e639d555 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:24.115874 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-973bdd0c-e395-4fdf-9b5f-6e01e639d555 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:24.124318 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-973bdd0c-e395-4fdf-9b5f-6e01e639d555 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:24.124800 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-973bdd0c-e395-4fdf-9b5f-6e01e639d555 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:24.125232 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-973bdd0c-e395-4fdf-9b5f-6e01e639d555 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:24.125948 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-973bdd0c-e395-4fdf-9b5f-6e01e639d555 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:24.126533 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-973bdd0c-e395-4fdf-9b5f-6e01e639d555 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:24.126881 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-973bdd0c-e395-4fdf-9b5f-6e01e639d555 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:24.147767 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-973bdd0c-e395-4fdf-9b5f-6e01e639d555 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] HTTP exception thrown: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-973bdd0c-e395-4fdf-9b5f-6e01e639d555 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Request method failure captured: Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 HTTP/1.1 Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSSDqC88R7K8cLVWjZy4WK9zDiB6pwu9x2QyB2x9zAV7V1y0va6W2DKi7FyWua95fjBbT8Eyql-6591277ISk8v9v3fQo4yBhJRoK93DHfRmOWK_exB1IlX87Hj7Ic02JfSlZ4LRSLZeEIXK59FTaLzb4HU_ETTTTFo1lBGf3CBby0A Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:46:24.149462 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:46:24.151105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/076e4d9f49a944c487077e845726ad82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_076e4d9f49a944c487077e845726ad82"}]}] Aug 29 20:46:24.151105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:24.151105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:24.151105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:24.151105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:24.151105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:46:24.151105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:46:24.151105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 70aaca5187e54f25ad94d9515278e039 Aug 29 20:46:24.151105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:24.151105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:46:24.151105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:24.151105 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7'} Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:46:24.152385 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. Aug 29 20:46:24.153933 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:24.155495 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-973bdd0c-e395-4fdf-9b5f-6e01e639d555 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Returning 404 to user: Instance 00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:46:24.155495 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-973bdd0c-e395-4fdf-9b5f-6e01e639d555 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7" status: 404 len: 111 microversion: 2.1 time: 0.040391 Aug 29 20:46:24.155495 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 542/1105] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:46:24 2022] GET /compute/v2.1/servers/00b2c5a8-5667-4e3e-b1e7-dfdeb94f05f7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:46:25.289249 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7b1b7af4-7fe3-4486-8507-f5e639c4ff60 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:25.289827 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7b1b7af4-7fe3-4486-8507-f5e639c4ff60 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:25.295768 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7b1b7af4-7fe3-4486-8507-f5e639c4ff60 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:25.296285 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7b1b7af4-7fe3-4486-8507-f5e639c4ff60 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:25.296711 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7b1b7af4-7fe3-4486-8507-f5e639c4ff60 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:25.297430 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7b1b7af4-7fe3-4486-8507-f5e639c4ff60 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:25.297908 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7b1b7af4-7fe3-4486-8507-f5e639c4ff60 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:25.298323 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7b1b7af4-7fe3-4486-8507-f5e639c4ff60 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:25.313746 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-7b1b7af4-7fe3-4486-8507-f5e639c4ff60 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] HTTP exception thrown: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7b1b7af4-7fe3-4486-8507-f5e639c4ff60 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Request method failure captured: Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: DELETE /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 HTTP/1.1 Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSSDqC88R7K8cLVWjZy4WK9zDiB6pwu9x2QyB2x9zAV7V1y0va6W2DKi7FyWua95fjBbT8Eyql-6591277ISk8v9v3fQo4yBhJRoK93DHfRmOWK_exB1IlX87Hj7Ic02JfSlZ4LRSLZeEIXK59FTaLzb4HU_ETTTTFo1lBGf3CBby0A Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:46:25.315299 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:46:25.316973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/076e4d9f49a944c487077e845726ad82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_076e4d9f49a944c487077e845726ad82"}]}] Aug 29 20:46:25.316973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:25.316973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:25.316973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:25.316973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:25.316973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:46:25.316973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:46:25.316973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 70aaca5187e54f25ad94d9515278e039 Aug 29 20:46:25.316973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:25.316973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:46:25.316973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:46:25.316973 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '1c72a3ce-9948-451c-8ca8-642d5dcb7447'} Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:46:25.318370 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:46:25.319916 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.321442 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7b1b7af4-7fe3-4486-8507-f5e639c4ff60 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Returning 404 to user: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:46:25.321442 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7b1b7af4-7fe3-4486-8507-f5e639c4ff60 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 404 len: 111 microversion: 2.1 time: 0.032403 Aug 29 20:46:25.321442 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 564/1106] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:46:25 2022] DELETE /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:46:25.326686 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3643b31c-575d-482f-9ebd-68785eb16721 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:25.327298 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-3643b31c-575d-482f-9ebd-68785eb16721 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 1c72a3ce-9948-451c-8ca8-642d5dcb7447] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:25.333826 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3643b31c-575d-482f-9ebd-68785eb16721 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:25.334321 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3643b31c-575d-482f-9ebd-68785eb16721 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:25.334748 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3643b31c-575d-482f-9ebd-68785eb16721 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:25.335446 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3643b31c-575d-482f-9ebd-68785eb16721 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:25.335894 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3643b31c-575d-482f-9ebd-68785eb16721 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:25.336397 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-3643b31c-575d-482f-9ebd-68785eb16721 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:25.351113 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-3643b31c-575d-482f-9ebd-68785eb16721 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] HTTP exception thrown: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3643b31c-575d-482f-9ebd-68785eb16721 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Request method failure captured: Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 HTTP/1.1 Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSSDqC88R7K8cLVWjZy4WK9zDiB6pwu9x2QyB2x9zAV7V1y0va6W2DKi7FyWua95fjBbT8Eyql-6591277ISk8v9v3fQo4yBhJRoK93DHfRmOWK_exB1IlX87Hj7Ic02JfSlZ4LRSLZeEIXK59FTaLzb4HU_ETTTTFo1lBGf3CBby0A Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:46:25.352673 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:46:25.354300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/076e4d9f49a944c487077e845726ad82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_076e4d9f49a944c487077e845726ad82"}]}] Aug 29 20:46:25.354300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:25.354300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:25.354300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:25.354300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:25.354300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:46:25.354300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:46:25.354300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 70aaca5187e54f25ad94d9515278e039 Aug 29 20:46:25.354300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:25.354300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:46:25.354300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:46:25.354300 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '1c72a3ce-9948-451c-8ca8-642d5dcb7447'} Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:46:25.355217 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. Aug 29 20:46:25.356716 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.357914 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-3643b31c-575d-482f-9ebd-68785eb16721 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Returning 404 to user: Instance 1c72a3ce-9948-451c-8ca8-642d5dcb7447 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:46:25.357914 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-3643b31c-575d-482f-9ebd-68785eb16721 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447" status: 404 len: 111 microversion: 2.1 time: 0.031233 Aug 29 20:46:25.357914 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 543/1107] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:46:25 2022] GET /compute/v2.1/servers/1c72a3ce-9948-451c-8ca8-642d5dcb7447 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:46:25.362755 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-90e685a7-44fa-4e57-92af-622fc0dfb192 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:25.363267 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-90e685a7-44fa-4e57-92af-622fc0dfb192 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:25.369991 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-90e685a7-44fa-4e57-92af-622fc0dfb192 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:25.370463 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-90e685a7-44fa-4e57-92af-622fc0dfb192 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:25.370889 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-90e685a7-44fa-4e57-92af-622fc0dfb192 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:25.372257 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-90e685a7-44fa-4e57-92af-622fc0dfb192 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:25.372257 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-90e685a7-44fa-4e57-92af-622fc0dfb192 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:25.372503 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-90e685a7-44fa-4e57-92af-622fc0dfb192 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:25.385845 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-90e685a7-44fa-4e57-92af-622fc0dfb192 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] HTTP exception thrown: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-90e685a7-44fa-4e57-92af-622fc0dfb192 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Request method failure captured: Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: DELETE /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 HTTP/1.1 Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSSDqC88R7K8cLVWjZy4WK9zDiB6pwu9x2QyB2x9zAV7V1y0va6W2DKi7FyWua95fjBbT8Eyql-6591277ISk8v9v3fQo4yBhJRoK93DHfRmOWK_exB1IlX87Hj7Ic02JfSlZ4LRSLZeEIXK59FTaLzb4HU_ETTTTFo1lBGf3CBby0A Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:46:25.387408 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:46:25.389035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/076e4d9f49a944c487077e845726ad82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_076e4d9f49a944c487077e845726ad82"}]}] Aug 29 20:46:25.389035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:25.389035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:25.389035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:25.389035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:25.389035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:46:25.389035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:46:25.389035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 70aaca5187e54f25ad94d9515278e039 Aug 29 20:46:25.389035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:25.389035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:46:25.389035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:46:25.389035 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '537b47db-7d5d-4bb8-8b81-b63759ecc7b8'} Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:46:25.389873 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:46:25.391384 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.393696 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-90e685a7-44fa-4e57-92af-622fc0dfb192 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Returning 404 to user: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:46:25.393696 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-90e685a7-44fa-4e57-92af-622fc0dfb192 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 404 len: 111 microversion: 2.1 time: 0.029891 Aug 29 20:46:25.393696 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 565/1108] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:46:25 2022] DELETE /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:46:25.397560 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-29002476-3f0a-4e32-96ab-03741d831aa7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:25.398174 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-29002476-3f0a-4e32-96ab-03741d831aa7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 537b47db-7d5d-4bb8-8b81-b63759ecc7b8] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:25.404342 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29002476-3f0a-4e32-96ab-03741d831aa7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:25.404832 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29002476-3f0a-4e32-96ab-03741d831aa7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:25.405267 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29002476-3f0a-4e32-96ab-03741d831aa7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:25.405975 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29002476-3f0a-4e32-96ab-03741d831aa7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:25.406430 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29002476-3f0a-4e32-96ab-03741d831aa7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:25.406878 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-29002476-3f0a-4e32-96ab-03741d831aa7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:25.421020 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-29002476-3f0a-4e32-96ab-03741d831aa7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] HTTP exception thrown: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-29002476-3f0a-4e32-96ab-03741d831aa7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Request method failure captured: Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 HTTP/1.1 Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSSDqC88R7K8cLVWjZy4WK9zDiB6pwu9x2QyB2x9zAV7V1y0va6W2DKi7FyWua95fjBbT8Eyql-6591277ISk8v9v3fQo4yBhJRoK93DHfRmOWK_exB1IlX87Hj7Ic02JfSlZ4LRSLZeEIXK59FTaLzb4HU_ETTTTFo1lBGf3CBby0A Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:46:25.422555 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:46:25.424319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/076e4d9f49a944c487077e845726ad82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_076e4d9f49a944c487077e845726ad82"}]}] Aug 29 20:46:25.424319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:25.424319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:25.424319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:25.424319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:25.424319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:46:25.424319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:46:25.424319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 70aaca5187e54f25ad94d9515278e039 Aug 29 20:46:25.424319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:25.424319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:46:25.424319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:46:25.424319 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '537b47db-7d5d-4bb8-8b81-b63759ecc7b8'} Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:46:25.425264 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. Aug 29 20:46:25.427463 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:25.428746 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-29002476-3f0a-4e32-96ab-03741d831aa7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Returning 404 to user: Instance 537b47db-7d5d-4bb8-8b81-b63759ecc7b8 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:46:25.428746 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-29002476-3f0a-4e32-96ab-03741d831aa7 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8" status: 404 len: 111 microversion: 2.1 time: 0.030377 Aug 29 20:46:25.428746 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 544/1109] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:46:25 2022] GET /compute/v2.1/servers/537b47db-7d5d-4bb8-8b81-b63759ecc7b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 20:46:26.565216 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7eeab5b0-5d00-4336-a27e-d0532564380d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:26.565744 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.compute.api [None req-7eeab5b0-5d00-4336-a27e-d0532564380d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127027) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:26.573083 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7eeab5b0-5d00-4336-a27e-d0532564380d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:26.573558 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7eeab5b0-5d00-4336-a27e-d0532564380d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:26.574039 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7eeab5b0-5d00-4336-a27e-d0532564380d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:26.574672 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7eeab5b0-5d00-4336-a27e-d0532564380d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:26.575117 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7eeab5b0-5d00-4336-a27e-d0532564380d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:26.575534 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG oslo_concurrency.lockutils [None req-7eeab5b0-5d00-4336-a27e-d0532564380d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:26.589515 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.wsgi [None req-7eeab5b0-5d00-4336-a27e-d0532564380d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] HTTP exception thrown: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7eeab5b0-5d00-4336-a27e-d0532564380d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Request method failure captured: Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: request: DELETE /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 HTTP/1.1 Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept: application/json Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Accept-Encoding: identity Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Connection: close Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Length: 0 Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Content-Type: application/json Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Host: 10.222.0.18 Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: Openstack-System-Scope: None Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: User-Agent: python-urllib3/1.26.12 Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Auth-Token: gAAAAABjDSSDqC88R7K8cLVWjZy4WK9zDiB6pwu9x2QyB2x9zAV7V1y0va6W2DKi7FyWua95fjBbT8Eyql-6591277ISk8v9v3fQo4yBhJRoK93DHfRmOWK_exB1IlX87Hj7Ic02JfSlZ4LRSLZeEIXK59FTaLzb4HU_ETTTTFo1lBGf3CBby0A Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Id: None Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Domain-Name: None Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Identity-Status: Confirmed Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Is-Admin-Project: True Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Id: default Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Domain-Name: Default Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Project-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Role: reader,member Aug 29 20:46:26.590756 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Roles: reader,member Aug 29 20:46:26.592583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/076e4d9f49a944c487077e845726ad82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_076e4d9f49a944c487077e845726ad82"}]}] Aug 29 20:46:26.592583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:26.592583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:26.592583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:26.592583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:26.592583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Id: default Aug 29 20:46:26.592583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Domain-Name: Default Aug 29 20:46:26.592583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Id: 70aaca5187e54f25ad94d9515278e039 Aug 29 20:46:26.592583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: X-User-Name: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:26.592583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: method: > Aug 29 20:46:26.592583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: exception: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:46:26.592583 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: action_args: {'id': '2ea03034-17ef-42a5-af06-60d8e43be248'} Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: {{(pid=127027) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:46:26.594457 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:46:26.596527 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: ERROR nova.api.openstack.wsgi Aug 29 20:46:26.598481 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: DEBUG nova.api.openstack.wsgi [None req-7eeab5b0-5d00-4336-a27e-d0532564380d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Returning 404 to user: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. {{(pid=127027) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:46:26.598481 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: INFO nova.api.openstack.requestlog [None req-7eeab5b0-5d00-4336-a27e-d0532564380d tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 404 len: 111 microversion: 2.1 time: 0.030879 Aug 29 20:46:26.598481 dv-cinder-854263-2-iscsi devstack@n-api.service[127027]: [pid: 127027|app: 0|req: 566/1110] 10.222.0.18 () {58 vars in 1239 bytes} [Mon Aug 29 20:46:26 2022] DELETE /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 20:46:26.600888 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-060cafe9-598a-4bb8-a67a-29faeb221f66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Calling method '>' {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 20:46:26.601510 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.compute.api [None req-060cafe9-598a-4bb8-a67a-29faeb221f66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] [instance: 2ea03034-17ef-42a5-af06-60d8e43be248] Fetching instance by UUID {{(pid=127028) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 20:46:26.608080 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-060cafe9-598a-4bb8-a67a-29faeb221f66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:26.608559 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-060cafe9-598a-4bb8-a67a-29faeb221f66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:26.608995 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-060cafe9-598a-4bb8-a67a-29faeb221f66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:26.609693 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-060cafe9-598a-4bb8-a67a-29faeb221f66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Acquiring lock "26164e1e-1563-420b-9abf-15fd66346c73" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 20:46:26.610146 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-060cafe9-598a-4bb8-a67a-29faeb221f66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 20:46:26.610568 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG oslo_concurrency.lockutils [None req-060cafe9-598a-4bb8-a67a-29faeb221f66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Lock "26164e1e-1563-420b-9abf-15fd66346c73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 20:46:26.625290 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.wsgi [None req-060cafe9-598a-4bb8-a67a-29faeb221f66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] HTTP exception thrown: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-060cafe9-598a-4bb8-a67a-29faeb221f66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Request method failure captured: Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: request: GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 HTTP/1.1 Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept: application/json Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Accept-Encoding: identity Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Connection: close Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Length: 0 Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Content-Type: application/json Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Host: 10.222.0.18 Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: Openstack-System-Scope: None Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: User-Agent: python-urllib3/1.26.12 Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Auth-Token: gAAAAABjDSSDqC88R7K8cLVWjZy4WK9zDiB6pwu9x2QyB2x9zAV7V1y0va6W2DKi7FyWua95fjBbT8Eyql-6591277ISk8v9v3fQo4yBhJRoK93DHfRmOWK_exB1IlX87Hj7Ic02JfSlZ4LRSLZeEIXK59FTaLzb4HU_ETTTTFo1lBGf3CBby0A Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Id: None Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Domain-Name: None Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Identity-Status: Confirmed Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Is-Admin-Project: True Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Id: default Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Domain-Name: Default Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Project-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Role: reader,member Aug 29 20:46:26.626868 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Roles: reader,member Aug 29 20:46:26.628788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/076e4d9f49a944c487077e845726ad82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/076e4d9f49a944c487077e845726ad82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_076e4d9f49a944c487077e845726ad82"}]}] Aug 29 20:46:26.628788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:26.628788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Id: 076e4d9f49a944c487077e845726ad82 Aug 29 20:46:26.628788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1391330237 Aug 29 20:46:26.628788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:26.628788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Id: default Aug 29 20:46:26.628788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Domain-Name: Default Aug 29 20:46:26.628788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Id: 70aaca5187e54f25ad94d9515278e039 Aug 29 20:46:26.628788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: X-User-Name: tempest-AttachVolumeNegativeTest-1391330237-project Aug 29 20:46:26.628788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: method: > Aug 29 20:46:26.628788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: exception: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:46:26.628788 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: action_args: {'id': '2ea03034-17ef-42a5-af06-60d8e43be248'} Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: {{(pid=127028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 20:46:26.629862 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. Aug 29 20:46:26.632050 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: ERROR nova.api.openstack.wsgi Aug 29 20:46:26.634102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: DEBUG nova.api.openstack.wsgi [None req-060cafe9-598a-4bb8-a67a-29faeb221f66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] Returning 404 to user: Instance 2ea03034-17ef-42a5-af06-60d8e43be248 could not be found. {{(pid=127028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 20:46:26.634102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: INFO nova.api.openstack.requestlog [None req-060cafe9-598a-4bb8-a67a-29faeb221f66 tempest-AttachVolumeNegativeTest-1391330237 tempest-AttachVolumeNegativeTest-1391330237-project] 10.222.0.18 "GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248" status: 404 len: 111 microversion: 2.1 time: 0.031372 Aug 29 20:46:26.634102 dv-cinder-854263-2-iscsi devstack@n-api.service[127028]: [pid: 127028|app: 0|req: 545/1111] 10.222.0.18 () {58 vars in 1236 bytes} [Mon Aug 29 20:46:26 2022] GET /compute/v2.1/servers/2ea03034-17ef-42a5-af06-60d8e43be248 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)